2023-07-11 14:09:04,592 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-07-11 14:09:05,046 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc 2023-07-11 14:09:05,066 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 14:09:05,067 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c, deleteOnExit=true 2023-07-11 14:09:05,067 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 14:09:05,068 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/test.cache.data in system properties and HBase conf 2023-07-11 14:09:05,068 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 14:09:05,069 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/hadoop.log.dir in system properties and HBase conf 2023-07-11 14:09:05,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 14:09:05,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 14:09:05,070 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 14:09:05,246 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 14:09:05,879 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 14:09:05,886 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 14:09:05,887 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 14:09:05,887 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 14:09:05,888 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 14:09:05,888 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 14:09:05,889 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 14:09:05,889 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 14:09:05,894 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 14:09:05,896 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 14:09:05,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/nfs.dump.dir in system properties and HBase conf 2023-07-11 14:09:05,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/java.io.tmpdir in system properties and HBase conf 2023-07-11 14:09:05,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 14:09:05,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 14:09:05,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 14:09:06,882 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 14:09:06,888 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 14:09:07,335 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 14:09:07,694 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 14:09:07,735 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 14:09:07,798 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 14:09:07,854 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/java.io.tmpdir/Jetty_localhost_43115_hdfs____albn4w/webapp 2023-07-11 14:09:08,145 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43115 2023-07-11 14:09:08,162 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 14:09:08,162 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 14:09:09,108 WARN [Listener at localhost/43437] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 14:09:09,427 WARN [Listener at localhost/43437] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 14:09:09,453 WARN [Listener at localhost/43437] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 14:09:09,461 INFO [Listener at localhost/43437] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 14:09:09,474 INFO [Listener at localhost/43437] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/java.io.tmpdir/Jetty_localhost_43237_datanode____.ldilwi/webapp 2023-07-11 14:09:09,618 INFO [Listener at localhost/43437] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43237 2023-07-11 14:09:10,220 WARN [Listener at localhost/44533] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 14:09:10,958 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8169f03eaa6f4807: Processing first storage report for DS-6468c55a-8ee1-49ee-b822-8f2680c74721 from datanode 7711d16e-95a7-4523-af51-8072bab1d975 2023-07-11 14:09:10,959 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8169f03eaa6f4807: from storage DS-6468c55a-8ee1-49ee-b822-8f2680c74721 node DatanodeRegistration(127.0.0.1:44551, datanodeUuid=7711d16e-95a7-4523-af51-8072bab1d975, infoPort=33293, infoSecurePort=0, ipcPort=44533, storageInfo=lv=-57;cid=testClusterID;nsid=821698898;c=1689084547010), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-11 14:09:10,960 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8169f03eaa6f4807: Processing first storage report for DS-0e1dabea-7536-488b-a953-df414022358b from datanode 7711d16e-95a7-4523-af51-8072bab1d975 2023-07-11 14:09:10,960 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8169f03eaa6f4807: from storage DS-0e1dabea-7536-488b-a953-df414022358b node DatanodeRegistration(127.0.0.1:44551, datanodeUuid=7711d16e-95a7-4523-af51-8072bab1d975, infoPort=33293, infoSecurePort=0, ipcPort=44533, storageInfo=lv=-57;cid=testClusterID;nsid=821698898;c=1689084547010), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 14:09:11,040 DEBUG [Listener at localhost/44533] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc 2023-07-11 14:09:11,117 INFO [Listener at localhost/44533] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c/zookeeper_0, clientPort=63702, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 14:09:11,134 INFO [Listener at localhost/44533] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63702 2023-07-11 14:09:11,142 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:11,145 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:11,898 INFO [Listener at localhost/44533] util.FSUtils(471): Created version file at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3 with version=8 2023-07-11 14:09:11,898 INFO [Listener at localhost/44533] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/hbase-staging 2023-07-11 14:09:12,277 INFO [Listener at localhost/44533] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 14:09:12,877 INFO [Listener at localhost/44533] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=3 2023-07-11 14:09:12,926 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:09:12,927 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 14:09:12,927 INFO [Listener at localhost/44533] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 14:09:12,927 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:09:12,927 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 14:09:13,079 INFO [Listener at localhost/44533] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 14:09:13,158 DEBUG [Listener at localhost/44533] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 14:09:13,277 INFO [Listener at localhost/44533] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33029 2023-07-11 14:09:13,289 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:13,292 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:13,317 INFO [Listener at localhost/44533] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33029 connecting to ZooKeeper ensemble=127.0.0.1:63702 2023-07-11 14:09:13,373 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:330290x0, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 14:09:13,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33029-0x10154a9a35c0000 connected 2023-07-11 14:09:13,410 DEBUG [Listener at localhost/44533] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:09:13,412 DEBUG [Listener at localhost/44533] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:09:13,416 DEBUG [Listener at localhost/44533] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 14:09:13,430 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33029 2023-07-11 14:09:13,431 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33029 2023-07-11 14:09:13,431 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33029 2023-07-11 14:09:13,434 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33029 2023-07-11 14:09:13,434 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33029 2023-07-11 14:09:13,441 INFO [Listener at localhost/44533] master.HMaster(444): hbase.rootdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3, hbase.cluster.distributed=false 2023-07-11 14:09:13,538 INFO [Listener at localhost/44533] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=3 2023-07-11 14:09:13,538 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:09:13,538 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 14:09:13,539 INFO [Listener at localhost/44533] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 14:09:13,539 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:09:13,539 INFO [Listener at localhost/44533] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 14:09:13,546 INFO [Listener at localhost/44533] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 14:09:13,550 INFO [Listener at localhost/44533] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46743 2023-07-11 14:09:13,552 INFO [Listener at localhost/44533] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 14:09:13,561 DEBUG [Listener at localhost/44533] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 14:09:13,562 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:13,566 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:13,568 INFO [Listener at localhost/44533] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46743 connecting to ZooKeeper ensemble=127.0.0.1:63702 2023-07-11 14:09:13,572 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:467430x0, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 14:09:13,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46743-0x10154a9a35c0001 connected 2023-07-11 14:09:13,574 DEBUG [Listener at localhost/44533] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:09:13,575 DEBUG [Listener at localhost/44533] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:09:13,576 DEBUG [Listener at localhost/44533] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 14:09:13,581 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46743 2023-07-11 14:09:13,582 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46743 2023-07-11 14:09:13,585 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46743 2023-07-11 14:09:13,586 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46743 2023-07-11 14:09:13,588 DEBUG [Listener at localhost/44533] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46743 2023-07-11 14:09:13,595 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:13,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 14:09:13,611 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:13,630 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 14:09:13,630 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 14:09:13,631 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:13,632 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 14:09:13,634 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,33029,1689084552049 from backup master directory 2023-07-11 14:09:13,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 14:09:13,638 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:13,638 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 14:09:13,639 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 14:09:13,640 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:13,643 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 14:09:13,645 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 14:09:13,800 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/hbase.id with ID: 20b49d8d-bbc5-4fa1-af1f-ab9bb4325373 2023-07-11 14:09:13,850 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:13,867 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:13,916 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x659a287b to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:13,963 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cdc5aaa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:13,996 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 14:09:13,999 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 14:09:14,022 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 14:09:14,022 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 14:09:14,025 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:09:14,030 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:09:14,032 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:09:14,069 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store-tmp 2023-07-11 14:09:14,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:14,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 14:09:14,102 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:09:14,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:09:14,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 14:09:14,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:09:14,102 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:09:14,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 14:09:14,106 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/WALs/jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:14,132 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33029%2C1689084552049, suffix=, logDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/WALs/jenkins-hbase9.apache.org,33029,1689084552049, archiveDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/oldWALs, maxLogs=10 2023-07-11 14:09:14,201 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44551,DS-6468c55a-8ee1-49ee-b822-8f2680c74721,DISK] 2023-07-11 14:09:14,212 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:09:14,298 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/WALs/jenkins-hbase9.apache.org,33029,1689084552049/jenkins-hbase9.apache.org%2C33029%2C1689084552049.1689084554142 2023-07-11 14:09:14,299 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44551,DS-6468c55a-8ee1-49ee-b822-8f2680c74721,DISK]] 2023-07-11 14:09:14,300 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:14,300 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:14,305 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:09:14,306 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:09:14,393 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:09:14,402 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 14:09:14,434 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 14:09:14,454 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:14,462 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:09:14,464 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:09:14,486 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:09:14,491 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:14,492 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74817437, jitterRate=0.11486668884754181}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:09:14,492 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 14:09:14,494 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 14:09:14,523 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 14:09:14,524 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 14:09:14,526 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:09:14,529 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 14:09:14,567 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-11 14:09:14,568 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 14:09:14,598 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 14:09:14,605 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 14:09:14,640 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 14:09:14,645 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 14:09:14,648 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 14:09:14,655 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 14:09:14,661 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 14:09:14,665 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:14,666 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 14:09:14,667 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 14:09:14,684 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 14:09:14,690 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 14:09:14,690 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 14:09:14,691 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:14,691 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,33029,1689084552049, sessionid=0x10154a9a35c0000, setting cluster-up flag (Was=false) 2023-07-11 14:09:14,711 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:14,717 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 14:09:14,722 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:14,730 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:14,737 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 14:09:14,739 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:14,742 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp 2023-07-11 14:09:14,797 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(951): ClusterId : 20b49d8d-bbc5-4fa1-af1f-ab9bb4325373 2023-07-11 14:09:14,803 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 14:09:14,811 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 14:09:14,811 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 14:09:14,817 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 14:09:14,818 DEBUG [RS:0;jenkins-hbase9:46743] zookeeper.ReadOnlyZKClient(139): Connect 0x0bb93727 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:14,831 DEBUG [RS:0;jenkins-hbase9:46743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57ec820, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:14,832 DEBUG [RS:0;jenkins-hbase9:46743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1415c57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 14:09:14,863 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:46743 2023-07-11 14:09:14,868 INFO [RS:0;jenkins-hbase9:46743] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 14:09:14,868 INFO [RS:0;jenkins-hbase9:46743] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 14:09:14,868 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 14:09:14,871 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33029,1689084552049 with isa=jenkins-hbase9.apache.org/172.31.2.10:46743, startcode=1689084553537 2023-07-11 14:09:14,894 DEBUG [RS:0;jenkins-hbase9:46743] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 14:09:14,902 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 14:09:14,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:09:14,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:09:14,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:09:14,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:09:14,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 14:09:14,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:14,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 14:09:14,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:14,934 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689084584934 2023-07-11 14:09:14,938 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 14:09:14,953 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 14:09:14,954 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 14:09:14,955 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 14:09:14,964 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 14:09:14,964 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 14:09:14,965 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 14:09:14,965 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 14:09:14,965 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 14:09:14,984 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:14,990 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 14:09:14,992 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41729, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 14:09:14,992 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 14:09:14,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 14:09:14,998 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 14:09:14,998 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 14:09:15,006 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689084555000,5,FailOnTimeoutGroup] 2023-07-11 14:09:15,014 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33029] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 14:09:15,025 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689084555015,5,FailOnTimeoutGroup] 2023-07-11 14:09:15,026 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,026 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 14:09:15,030 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,030 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,058 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 14:09:15,060 WARN [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 14:09:15,161 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33029,1689084552049 with isa=jenkins-hbase9.apache.org/172.31.2.10:46743, startcode=1689084553537 2023-07-11 14:09:15,167 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33029] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:15,173 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3 2023-07-11 14:09:15,173 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43437 2023-07-11 14:09:15,173 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 14:09:15,178 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:09:15,179 DEBUG [RS:0;jenkins-hbase9:46743] zookeeper.ZKUtil(162): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:15,179 WARN [RS:0;jenkins-hbase9:46743] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 14:09:15,179 INFO [RS:0;jenkins-hbase9:46743] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:09:15,180 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/WALs/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:15,181 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,46743,1689084553537] 2023-07-11 14:09:15,189 DEBUG [RS:0;jenkins-hbase9:46743] zookeeper.ZKUtil(162): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:15,199 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 14:09:15,207 INFO [RS:0;jenkins-hbase9:46743] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 14:09:15,227 INFO [RS:0;jenkins-hbase9:46743] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 14:09:15,231 INFO [RS:0;jenkins-hbase9:46743] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:09:15,232 INFO [RS:0;jenkins-hbase9:46743] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,233 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 14:09:15,242 INFO [RS:0;jenkins-hbase9:46743] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,242 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,242 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,243 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,243 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,243 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,243 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 14:09:15,243 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,244 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,244 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,244 DEBUG [RS:0;jenkins-hbase9:46743] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:09:15,246 INFO [RS:0;jenkins-hbase9:46743] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,246 INFO [RS:0;jenkins-hbase9:46743] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,246 INFO [RS:0;jenkins-hbase9:46743] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,268 INFO [RS:0;jenkins-hbase9:46743] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 14:09:15,271 INFO [RS:0;jenkins-hbase9:46743] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46743,1689084553537-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:15,297 INFO [RS:0;jenkins-hbase9:46743] regionserver.Replication(203): jenkins-hbase9.apache.org,46743,1689084553537 started 2023-07-11 14:09:15,297 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,46743,1689084553537, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:46743, sessionid=0x10154a9a35c0001 2023-07-11 14:09:15,297 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 14:09:15,297 DEBUG [RS:0;jenkins-hbase9:46743] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:15,297 DEBUG [RS:0;jenkins-hbase9:46743] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46743,1689084553537' 2023-07-11 14:09:15,298 DEBUG [RS:0;jenkins-hbase9:46743] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:15,298 DEBUG [RS:0;jenkins-hbase9:46743] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:15,299 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 14:09:15,299 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 14:09:15,299 DEBUG [RS:0;jenkins-hbase9:46743] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:15,299 DEBUG [RS:0;jenkins-hbase9:46743] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46743,1689084553537' 2023-07-11 14:09:15,299 DEBUG [RS:0;jenkins-hbase9:46743] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 14:09:15,299 DEBUG [RS:0;jenkins-hbase9:46743] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 14:09:15,300 DEBUG [RS:0;jenkins-hbase9:46743] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 14:09:15,300 INFO [RS:0;jenkins-hbase9:46743] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 14:09:15,300 INFO [RS:0;jenkins-hbase9:46743] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 14:09:15,415 INFO [RS:0;jenkins-hbase9:46743] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46743%2C1689084553537, suffix=, logDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/WALs/jenkins-hbase9.apache.org,46743,1689084553537, archiveDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/oldWALs, maxLogs=32 2023-07-11 14:09:15,434 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44551,DS-6468c55a-8ee1-49ee-b822-8f2680c74721,DISK] 2023-07-11 14:09:15,438 INFO [RS:0;jenkins-hbase9:46743] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/WALs/jenkins-hbase9.apache.org,46743,1689084553537/jenkins-hbase9.apache.org%2C46743%2C1689084553537.1689084555418 2023-07-11 14:09:15,438 DEBUG [RS:0;jenkins-hbase9:46743] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44551,DS-6468c55a-8ee1-49ee-b822-8f2680c74721,DISK]] 2023-07-11 14:09:15,445 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:15,446 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:15,447 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3 2023-07-11 14:09:15,881 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:15,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 14:09:15,888 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/info 2023-07-11 14:09:15,889 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 14:09:15,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:15,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 14:09:15,893 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:09:15,894 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 14:09:15,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:15,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 14:09:15,898 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/table 2023-07-11 14:09:15,899 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 14:09:15,900 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:15,901 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740 2023-07-11 14:09:15,903 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740 2023-07-11 14:09:15,907 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:09:15,910 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 14:09:15,914 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:15,915 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71856145, jitterRate=0.0707399994134903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:09:15,915 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 14:09:15,915 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 14:09:15,915 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 14:09:15,916 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 14:09:15,916 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 14:09:15,916 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 14:09:15,917 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 14:09:15,917 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 14:09:15,923 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 14:09:15,923 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 14:09:15,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 14:09:15,944 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:09:15,949 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 14:09:16,102 DEBUG [jenkins-hbase9:33029] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-11 14:09:16,106 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,46743,1689084553537, state=OPENING 2023-07-11 14:09:16,117 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 14:09:16,120 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:16,121 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 14:09:16,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:16,333 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:16,336 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 14:09:16,345 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 14:09:16,362 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 14:09:16,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:09:16,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46743%2C1689084553537.meta, suffix=.meta, logDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/WALs/jenkins-hbase9.apache.org,46743,1689084553537, archiveDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/oldWALs, maxLogs=32 2023-07-11 14:09:16,408 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44551,DS-6468c55a-8ee1-49ee-b822-8f2680c74721,DISK] 2023-07-11 14:09:16,454 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/WALs/jenkins-hbase9.apache.org,46743,1689084553537/jenkins-hbase9.apache.org%2C46743%2C1689084553537.meta.1689084556373.meta 2023-07-11 14:09:16,461 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44551,DS-6468c55a-8ee1-49ee-b822-8f2680c74721,DISK]] 2023-07-11 14:09:16,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:16,464 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 14:09:16,488 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 14:09:16,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 14:09:16,507 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 14:09:16,507 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:16,507 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 14:09:16,507 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 14:09:16,513 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 14:09:16,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/info 2023-07-11 14:09:16,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/info 2023-07-11 14:09:16,516 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 14:09:16,518 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:16,518 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 14:09:16,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:09:16,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:09:16,521 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 14:09:16,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:16,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 14:09:16,524 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/table 2023-07-11 14:09:16,524 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/table 2023-07-11 14:09:16,525 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 14:09:16,526 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:16,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740 2023-07-11 14:09:16,532 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740 2023-07-11 14:09:16,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:09:16,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 14:09:16,541 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60136538, jitterRate=-0.10389575362205505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:09:16,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 14:09:16,552 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689084556322 2023-07-11 14:09:16,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 14:09:16,574 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 14:09:16,574 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,46743,1689084553537, state=OPEN 2023-07-11 14:09:16,578 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 14:09:16,579 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 14:09:16,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 14:09:16,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,46743,1689084553537 in 449 msec 2023-07-11 14:09:16,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 14:09:16,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 655 msec 2023-07-11 14:09:16,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7860 sec 2023-07-11 14:09:16,598 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689084556598, completionTime=-1 2023-07-11 14:09:16,598 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-11 14:09:16,598 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:09:16,672 DEBUG [hconnection-0x5263849a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:16,676 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:16,695 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-11 14:09:16,695 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689084616695 2023-07-11 14:09:16,695 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689084676695 2023-07-11 14:09:16,695 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-07-11 14:09:16,721 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33029,1689084552049-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:16,722 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33029,1689084552049-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:16,722 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33029,1689084552049-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:16,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:33029, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:16,725 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 14:09:16,731 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 14:09:16,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 14:09:16,746 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 14:09:16,762 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 14:09:16,764 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:09:16,767 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:09:16,794 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:16,796 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6 empty. 2023-07-11 14:09:16,797 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:16,797 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 14:09:17,222 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:17,225 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => cec49ede7f05373b7ad17290ed0e3ae6, NAME => 'hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:17,241 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:17,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing cec49ede7f05373b7ad17290ed0e3ae6, disabling compactions & flushes 2023-07-11 14:09:17,242 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:09:17,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:09:17,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. after waiting 0 ms 2023-07-11 14:09:17,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:09:17,242 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:09:17,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for cec49ede7f05373b7ad17290ed0e3ae6: 2023-07-11 14:09:17,247 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:09:17,265 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689084557250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084557250"}]},"ts":"1689084557250"} 2023-07-11 14:09:17,298 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:09:17,300 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:09:17,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084557300"}]},"ts":"1689084557300"} 2023-07-11 14:09:17,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 14:09:17,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cec49ede7f05373b7ad17290ed0e3ae6, ASSIGN}] 2023-07-11 14:09:17,325 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cec49ede7f05373b7ad17290ed0e3ae6, ASSIGN 2023-07-11 14:09:17,327 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cec49ede7f05373b7ad17290ed0e3ae6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:17,478 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cec49ede7f05373b7ad17290ed0e3ae6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:17,479 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689084557478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084557478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084557478"}]},"ts":"1689084557478"} 2023-07-11 14:09:17,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cec49ede7f05373b7ad17290ed0e3ae6, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:17,646 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:09:17,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cec49ede7f05373b7ad17290ed0e3ae6, NAME => 'hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:17,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:17,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:17,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:17,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:17,654 INFO [StoreOpener-cec49ede7f05373b7ad17290ed0e3ae6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:17,657 DEBUG [StoreOpener-cec49ede7f05373b7ad17290ed0e3ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/info 2023-07-11 14:09:17,658 DEBUG [StoreOpener-cec49ede7f05373b7ad17290ed0e3ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/info 2023-07-11 14:09:17,658 INFO [StoreOpener-cec49ede7f05373b7ad17290ed0e3ae6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cec49ede7f05373b7ad17290ed0e3ae6 columnFamilyName info 2023-07-11 14:09:17,660 INFO [StoreOpener-cec49ede7f05373b7ad17290ed0e3ae6-1] regionserver.HStore(310): Store=cec49ede7f05373b7ad17290ed0e3ae6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:17,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:17,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:17,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:09:17,679 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:17,681 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened cec49ede7f05373b7ad17290ed0e3ae6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69734745, jitterRate=0.03912867605686188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:09:17,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for cec49ede7f05373b7ad17290ed0e3ae6: 2023-07-11 14:09:17,683 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6., pid=6, masterSystemTime=1689084557639 2023-07-11 14:09:17,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:09:17,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:09:17,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cec49ede7f05373b7ad17290ed0e3ae6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:17,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689084557691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084557691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084557691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084557691"}]},"ts":"1689084557691"} 2023-07-11 14:09:17,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 14:09:17,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cec49ede7f05373b7ad17290ed0e3ae6, server=jenkins-hbase9.apache.org,46743,1689084553537 in 215 msec 2023-07-11 14:09:17,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 14:09:17,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cec49ede7f05373b7ad17290ed0e3ae6, ASSIGN in 382 msec 2023-07-11 14:09:17,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:09:17,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084557710"}]},"ts":"1689084557710"} 2023-07-11 14:09:17,716 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 14:09:17,722 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:09:17,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 975 msec 2023-07-11 14:09:17,766 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 14:09:17,767 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 14:09:17,767 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:09:17,835 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 14:09:17,855 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 14:09:17,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 48 msec 2023-07-11 14:09:17,877 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:09:17,891 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 14:09:17,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-11 14:09:17,918 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 14:09:17,921 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 14:09:17,921 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.281sec 2023-07-11 14:09:17,924 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 14:09:17,926 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 14:09:17,926 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 14:09:17,927 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33029,1689084552049-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 14:09:17,928 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33029,1689084552049-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 14:09:17,962 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 14:09:18,059 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(139): Connect 0x799bfff6 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:18,064 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d21d903, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:18,078 DEBUG [hconnection-0x21ed682e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:18,092 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:18,103 INFO [Listener at localhost/44533] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:09:18,104 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(139): Connect 0x2802e06e to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:18,109 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@421ff0ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:18,109 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:09:18,135 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=734, ProcessCount=175, AvailableMemoryMB=1773 2023-07-11 14:09:18,146 DEBUG [Listener at localhost/44533] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:09:18,150 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:09:18,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 14:09:18,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:18,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:09:18,169 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:09:18,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-07-11 14:09:18,172 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:18,173 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953 empty. 2023-07-11 14:09:18,175 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:18,175 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-07-11 14:09:18,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:09:18,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:09:18,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:09:18,596 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:18,598 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5468830e11f70f9b65ff569cddc29953, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:18,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:09:19,012 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:19,013 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 5468830e11f70f9b65ff569cddc29953, disabling compactions & flushes 2023-07-11 14:09:19,013 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:19,013 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:19,013 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. after waiting 0 ms 2023-07-11 14:09:19,013 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:19,013 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:19,013 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:19,018 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:09:19,020 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689084559019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084559019"}]},"ts":"1689084559019"} 2023-07-11 14:09:19,023 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:09:19,025 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:09:19,025 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084559025"}]},"ts":"1689084559025"} 2023-07-11 14:09:19,028 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-07-11 14:09:19,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, ASSIGN}] 2023-07-11 14:09:19,035 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, ASSIGN 2023-07-11 14:09:19,037 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:19,188 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5468830e11f70f9b65ff569cddc29953, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:19,189 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689084559188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084559188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084559188"}]},"ts":"1689084559188"} 2023-07-11 14:09:19,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5468830e11f70f9b65ff569cddc29953, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:19,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:09:19,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:19,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5468830e11f70f9b65ff569cddc29953, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:19,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:19,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:19,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:19,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:19,357 INFO [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:19,359 DEBUG [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:19,359 DEBUG [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:19,362 INFO [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5468830e11f70f9b65ff569cddc29953 columnFamilyName family1 2023-07-11 14:09:19,366 INFO [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] regionserver.HStore(310): Store=5468830e11f70f9b65ff569cddc29953/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:19,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:19,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:19,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:19,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:19,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5468830e11f70f9b65ff569cddc29953; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67074840, jitterRate=-5.069971084594727E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:09:19,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:19,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953., pid=11, masterSystemTime=1689084559345 2023-07-11 14:09:19,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:19,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:19,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5468830e11f70f9b65ff569cddc29953, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:19,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689084559384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084559384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084559384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084559384"}]},"ts":"1689084559384"} 2023-07-11 14:09:19,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 14:09:19,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5468830e11f70f9b65ff569cddc29953, server=jenkins-hbase9.apache.org,46743,1689084553537 in 196 msec 2023-07-11 14:09:19,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 14:09:19,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, ASSIGN in 358 msec 2023-07-11 14:09:19,396 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:09:19,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084559396"}]},"ts":"1689084559396"} 2023-07-11 14:09:19,399 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-07-11 14:09:19,402 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:09:19,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2400 sec 2023-07-11 14:09:20,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:09:20,297 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-07-11 14:09:20,315 DEBUG [hconnection-0x5b358c6c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:20,318 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:20,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:20,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,489 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:20,489 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:20,489 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:20,489 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:20,491 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,491 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:20,543 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:20,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:20,544 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,544 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:20,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,546 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:20,548 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:20,548 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:20,548 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:20,549 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:20,549 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:20,549 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:20,550 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:20,551 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 14:09:21,125 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b20b10b8b96040d3aa9df8eee70b00bd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b20b10b8b96040d3aa9df8eee70b00bd 2023-07-11 14:09:21,205 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 14:09:21,207 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 14:09:21,208 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:21,543 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/67034c0689414aaa98e8a2e440b4ab26 2023-07-11 14:09:21,555 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/67034c0689414aaa98e8a2e440b4ab26 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67034c0689414aaa98e8a2e440b4ab26 2023-07-11 14:09:21,566 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67034c0689414aaa98e8a2e440b4ab26, entries=1000, sequenceid=5, filesize=175.8 K 2023-07-11 14:09:21,569 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 1017ms, sequenceid=5, compaction requested=false 2023-07-11 14:09:21,570 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:21,570 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:21,570 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:21,570 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:21,570 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,570 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:21,570 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:21,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,573 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:21,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:21,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:21,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:21,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:21,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:21,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:21,576 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:21,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45ab348a[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:21,576 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,578 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,579 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:21,579 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:21,579 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:21,579 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,579 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:21,581 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:21,581 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,581 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:21,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:21,581 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:21,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:21,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:21,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:21,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:21,587 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:21,587 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:21,587 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:21,587 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,587 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:21,590 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,590 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,590 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:21,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:21,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:21,591 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,594 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,604 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,604 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:21,604 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:21,605 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:21,605 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,605 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,605 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,605 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,605 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,605 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:21,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:21,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:21,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:21,608 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:21,608 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:21,708 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:21,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:21,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:21,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:21,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,729 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:21,729 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:21,729 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:21,729 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:21,730 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,730 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,732 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:21,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:21,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:21,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:21,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:21,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:21,734 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:21,734 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:21,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:21,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:21,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:21,735 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:21,735 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:21,735 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 14:09:21,762 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c2e54c19c46f4ffc961d161d88406148 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c2e54c19c46f4ffc961d161d88406148 2023-07-11 14:09:22,035 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:09:22,179 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/de0e8a0ae17048d0b6cdd1b5267109fd 2023-07-11 14:09:22,191 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/de0e8a0ae17048d0b6cdd1b5267109fd as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/de0e8a0ae17048d0b6cdd1b5267109fd 2023-07-11 14:09:22,201 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/de0e8a0ae17048d0b6cdd1b5267109fd, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 14:09:22,203 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 468ms, sequenceid=9, compaction requested=false 2023-07-11 14:09:22,203 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:22,203 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:22,203 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:22,203 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:22,203 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,204 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:22,204 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:22,207 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,207 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:22,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:22,208 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,208 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:22,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:22,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:22,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:22,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:22,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76965f07[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:22,210 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:22,211 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,212 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,212 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:22,212 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:22,212 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:22,212 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,212 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:22,214 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:22,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:22,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:22,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:22,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:22,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:22,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:22,219 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:22,219 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:22,219 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:22,219 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,219 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:22,229 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,229 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:22,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,229 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:22,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:22,230 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:22,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,239 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:22,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:22,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:22,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 14:09:22,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:22,241 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:22,241 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:22,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:22,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:22,269 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 14:09:22,269 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 14:09:22,342 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:22,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:22,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:22,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:22,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,366 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:22,366 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:22,366 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:22,367 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:22,367 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,367 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,369 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:22,369 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:22,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:22,373 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,373 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:22,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,374 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,375 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:22,375 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,375 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:22,375 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:22,375 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:22,376 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:22,376 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:22,376 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:22,376 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:22,376 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:22,414 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014c17c390bb214252b58af480e0dd4429 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014c17c390bb214252b58af480e0dd4429 2023-07-11 14:09:22,829 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/a313b77cbd3d4d07b7daf7b2afbd81d3 2023-07-11 14:09:22,839 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/a313b77cbd3d4d07b7daf7b2afbd81d3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/a313b77cbd3d4d07b7daf7b2afbd81d3 2023-07-11 14:09:22,856 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/a313b77cbd3d4d07b7daf7b2afbd81d3, entries=1, sequenceid=13, filesize=5.0 K 2023-07-11 14:09:22,858 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 482ms, sequenceid=13, compaction requested=true 2023-07-11 14:09:22,858 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:22,858 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:22,858 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:22,860 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:22,860 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,860 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:22,860 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:22,862 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,863 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:22,863 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:22,864 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:22,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:22,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:22,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@464e1ab4[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:22,866 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:22,867 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,869 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:22,870 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:22,870 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:22,870 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,870 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:22,872 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,878 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:22,878 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:22,878 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:22,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:22,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:22,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:22,880 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:22,881 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:22,881 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:22,881 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,881 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:22,883 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,883 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:22,883 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:22,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,885 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,888 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:22,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:22,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:22,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:22,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,894 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,894 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:22,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:22,895 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:22,895 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:22,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:22,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:22,996 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:22,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:23,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:23,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:23,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,009 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:23,009 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:23,010 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:23,010 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:23,010 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,011 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,013 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:23,013 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:23,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:23,013 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,013 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:23,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:23,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,015 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,015 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:23,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,015 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:23,015 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:23,016 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:23,017 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:23,017 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:23,017 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:23,018 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:23,018 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:23,062 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fd191334833e45e989d5233b3f97182d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fd191334833e45e989d5233b3f97182d 2023-07-11 14:09:23,476 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/340270d162744eefb1afe5feb4e84e4b 2023-07-11 14:09:23,487 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/340270d162744eefb1afe5feb4e84e4b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/340270d162744eefb1afe5feb4e84e4b 2023-07-11 14:09:23,501 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/340270d162744eefb1afe5feb4e84e4b, entries=1, sequenceid=17, filesize=5.0 K 2023-07-11 14:09:23,503 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 485ms, sequenceid=17, compaction requested=true 2023-07-11 14:09:23,503 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:23,503 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:23,503 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:23,504 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:23,504 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,504 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:23,504 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:23,507 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,507 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:23,507 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,507 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:23,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:23,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61575cda[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:23,510 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:23,510 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,513 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,513 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:23,513 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:23,513 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:23,513 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,513 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:23,515 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,515 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:23,515 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:23,516 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:23,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:23,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:23,520 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:23,521 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:23,521 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:23,521 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,521 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:23,523 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,523 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:23,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,523 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:23,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:23,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:23,525 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,527 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,533 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:23,533 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,533 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:23,533 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 14:09:23,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:23,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:23,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:23,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:23,535 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:23,535 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:23,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:23,635 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:23,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:23,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:23,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:23,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,663 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:23,663 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:23,663 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:23,663 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:23,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,666 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:23,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:23,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:23,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:23,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:23,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:23,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,673 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:23,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:23,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:23,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:23,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:23,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:23,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:23,674 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:23,675 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:23,675 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:24,128 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280ac73d0a36164478af4dbcf6e2612e30 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280ac73d0a36164478af4dbcf6e2612e30 2023-07-11 14:09:24,166 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/bd30622ea13e4923b38fa136e0b2ccf6 2023-07-11 14:09:24,179 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/bd30622ea13e4923b38fa136e0b2ccf6 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/bd30622ea13e4923b38fa136e0b2ccf6 2023-07-11 14:09:24,192 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/bd30622ea13e4923b38fa136e0b2ccf6, entries=1, sequenceid=21, filesize=5.0 K 2023-07-11 14:09:24,193 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 518ms, sequenceid=21, compaction requested=true 2023-07-11 14:09:24,193 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:24,193 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:24,193 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:24,194 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:24,194 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,194 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:24,194 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:24,200 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,200 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,200 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,200 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:24,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:24,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dc42b1e[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:24,203 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:24,203 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,205 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:24,205 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:24,205 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,205 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:24,205 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:24,207 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,207 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,207 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:24,207 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:24,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:24,210 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:24,210 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:24,210 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:24,210 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,210 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:24,212 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,213 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,213 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:24,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,214 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:24,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:24,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,216 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,221 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:24,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 14:09:24,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:24,222 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,222 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:24,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:24,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:24,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:24,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:24,222 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:24,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:24,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:24,223 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:24,323 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:24,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:24,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:24,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:24,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,338 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:24,338 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:24,342 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:24,342 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:24,343 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,343 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,344 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,344 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:24,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:24,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:24,345 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,345 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:24,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,354 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,354 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:24,354 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,355 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:24,355 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:24,355 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:24,357 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:24,357 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:24,358 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:24,358 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:24,358 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:24,431 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316e972e5c99a540cd89dbdec4b611b073 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512316e972e5c99a540cd89dbdec4b611b073 2023-07-11 14:09:24,459 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/0c27fcf3978b42eb90d1d581fc4e3098 2023-07-11 14:09:24,475 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/0c27fcf3978b42eb90d1d581fc4e3098 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0c27fcf3978b42eb90d1d581fc4e3098 2023-07-11 14:09:24,492 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0c27fcf3978b42eb90d1d581fc4e3098, entries=1, sequenceid=25, filesize=5.0 K 2023-07-11 14:09:24,496 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 138ms, sequenceid=25, compaction requested=true 2023-07-11 14:09:24,496 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:24,496 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:24,496 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:24,497 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:24,497 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,497 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:24,497 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:24,499 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,499 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,499 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,499 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:24,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@396e2dc6[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:24,510 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:24,510 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,511 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:24,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:24,512 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,512 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:24,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:24,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:24,514 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:24,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:24,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:24,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:24,521 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:24,521 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:24,521 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:24,521 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,521 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:24,524 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,524 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:24,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,524 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,526 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,530 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:24,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 14:09:24,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:24,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:24,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:24,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,534 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:24,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:24,535 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:24,535 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:24,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:24,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:24,635 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:24,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:24,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:24,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:24,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,654 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:24,654 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:24,654 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:24,654 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:24,655 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,655 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,657 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:24,657 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,659 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,659 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,661 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:24,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,661 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:24,661 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:24,662 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:24,664 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:24,664 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:24,669 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:24,670 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:24,670 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:24,715 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016eec4808e61e40f09146db192a98a28f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016eec4808e61e40f09146db192a98a28f 2023-07-11 14:09:24,773 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/c349e0928bbc421bbf12ea7592fff101 2023-07-11 14:09:24,789 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/c349e0928bbc421bbf12ea7592fff101 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/c349e0928bbc421bbf12ea7592fff101 2023-07-11 14:09:24,803 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/c349e0928bbc421bbf12ea7592fff101, entries=1, sequenceid=29, filesize=5.0 K 2023-07-11 14:09:24,805 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 135ms, sequenceid=29, compaction requested=true 2023-07-11 14:09:24,805 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:24,806 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:24,806 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:24,807 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:24,807 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,807 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:24,807 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:24,809 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,809 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,810 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,810 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:24,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:24,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fc31be5[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:24,813 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:24,813 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,816 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,816 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:24,816 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:24,816 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,816 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:24,816 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:24,818 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:24,818 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,818 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:24,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,818 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:24,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:24,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:24,823 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:24,823 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:24,823 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:24,823 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,823 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:24,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:24,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:24,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:24,826 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:24,830 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:24,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:24,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:24,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:24,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:24,840 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:24,842 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:24,842 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:24,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:24,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:24,942 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:24,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:24,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:24,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:24,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,957 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:24,957 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:24,958 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:24,958 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:24,959 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,959 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,960 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:24,960 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:24,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:24,961 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:24,961 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,963 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,965 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:24,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:24,966 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:24,966 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:24,966 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:24,970 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:24,971 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:24,971 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:24,971 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:24,971 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:25,022 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010352076cf7096e427cb356d1515e76f47a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010352076cf7096e427cb356d1515e76f47a 2023-07-11 14:09:25,039 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/770988f586974d468c889c3ebefa0d50 2023-07-11 14:09:25,055 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/770988f586974d468c889c3ebefa0d50 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/770988f586974d468c889c3ebefa0d50 2023-07-11 14:09:25,066 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/770988f586974d468c889c3ebefa0d50, entries=1, sequenceid=33, filesize=5.0 K 2023-07-11 14:09:25,068 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 97ms, sequenceid=33, compaction requested=true 2023-07-11 14:09:25,068 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:25,068 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:25,068 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:25,069 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:25,069 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,069 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:25,069 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:25,073 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,074 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:25,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:25,074 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,074 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:25,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:25,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:25,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:25,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5429374b[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:25,078 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:25,078 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,080 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,080 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:25,080 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:25,080 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:25,081 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,081 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:25,083 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:25,083 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:25,083 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:25,084 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:25,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:25,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:25,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:25,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:25,094 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:25,094 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:25,094 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:25,094 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,094 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:25,097 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,097 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:25,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,097 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:25,098 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,101 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:25,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,105 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:25,105 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:25,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:25,105 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,105 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:25,105 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,105 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,106 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 14:09:25,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:25,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:25,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:25,107 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:25,107 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:25,106 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,107 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,107 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,207 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:25,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:25,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:25,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:25,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,234 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:25,234 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:25,234 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:25,235 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:25,235 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,235 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:25,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:25,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:25,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,241 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,242 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:25,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,242 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:25,242 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:25,242 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:25,243 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:25,243 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:25,243 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:25,243 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:25,243 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:25,682 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090792b48c0e4bd249499df15c301bd86d62 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090792b48c0e4bd249499df15c301bd86d62 2023-07-11 14:09:25,702 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/39cbcd36918f43c3ae4a6476dee9301c 2023-07-11 14:09:25,712 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/39cbcd36918f43c3ae4a6476dee9301c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/39cbcd36918f43c3ae4a6476dee9301c 2023-07-11 14:09:25,724 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/39cbcd36918f43c3ae4a6476dee9301c, entries=1, sequenceid=37, filesize=5.0 K 2023-07-11 14:09:25,725 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 482ms, sequenceid=37, compaction requested=true 2023-07-11 14:09:25,726 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:25,726 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:25,726 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:25,726 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:25,726 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,727 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:25,727 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:25,729 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,729 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:25,729 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,729 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:25,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:25,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8e96a0b[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:25,731 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:25,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,733 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,733 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:25,733 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:25,733 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:25,733 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,733 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:25,736 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:25,736 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,736 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:25,736 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:25,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:25,740 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:25,740 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:25,740 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:25,740 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,740 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:25,742 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,742 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:25,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,742 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:25,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:25,743 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:25,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,745 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,749 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,749 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,749 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,749 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,750 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,750 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,750 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,750 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:25,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:25,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:25,754 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:25,754 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:25,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:25,754 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:25,754 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:25,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:25,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:25,855 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:25,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:25,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:25,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:25,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,878 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:25,878 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:25,888 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 14:09:25,888 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 14:09:25,890 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,890 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,892 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:25,892 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:25,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,894 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:25,894 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:25,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,898 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,913 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 14:09:25,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:25,914 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 14:09:25,914 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:25,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 14:09:25,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:25,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:25,916 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:25,916 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. started... 2023-07-11 14:09:25,916 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5468830e11f70f9b65ff569cddc29953 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:25,993 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112065a75146cb594b42a536f8786e536193 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112065a75146cb594b42a536f8786e536193 2023-07-11 14:09:26,018 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/0a1456205e754b359a8e2b139e72ddd4 2023-07-11 14:09:26,028 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/0a1456205e754b359a8e2b139e72ddd4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0a1456205e754b359a8e2b139e72ddd4 2023-07-11 14:09:26,036 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0a1456205e754b359a8e2b139e72ddd4, entries=1, sequenceid=41, filesize=5.0 K 2023-07-11 14:09:26,038 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5468830e11f70f9b65ff569cddc29953 in 122ms, sequenceid=41, compaction requested=true 2023-07-11 14:09:26,038 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:26,038 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:26,038 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:26,039 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:26,039 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,039 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 14:09:26,039 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 14:09:26,041 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,041 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:26,042 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,042 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:26,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 14:09:26,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@402166cd[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:26,044 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 14:09:26,044 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,046 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 14:09:26,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 14:09:26,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:26,046 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,046 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:26,052 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,052 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 14:09:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:26,053 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:26,053 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 14:09:26,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:26,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:26,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:26,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 14:09:26,057 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 14:09:26,057 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:26,057 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:26,057 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,057 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:26,060 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,060 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:26,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,060 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:26,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:26,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:26,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:26,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:26,061 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:26,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,062 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:26,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,066 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:26,066 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:26,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:26,066 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:26,066 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,066 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,066 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:26,066 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,067 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,067 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 14:09:26,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:26,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:26,066 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:26,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:26,068 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:26,069 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:26,169 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:26,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:26,177 DEBUG [Listener at localhost/44533] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 14:09:26,180 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 14:09:26,181 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:26,197 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 14:09:26,198 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 14:09:26,200 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:26,200 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085166200 2023-07-11 14:09:26,201 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:09:26,207 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-07-11 14:09:26,207 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:26,207 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x3852d21a to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:26,212 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@904ad88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:26,214 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,312 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031bd30ff4ea154e88a1e746d4a248e7d2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031bd30ff4ea154e88a1e746d4a248e7d2 2023-07-11 14:09:26,314 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:26,333 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:26,334 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:26,348 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:09:26,350 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:09:26,397 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2b6db698a94e75a0672a0232a4488b first=Optional[r3] last=Optional[r6] 2023-07-11 14:09:26,411 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2b6db698a94e75a0672a0232a4488b}] 2023-07-11 14:09:26,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2b6db698a94e75a0672a0232a4488b for inclusion in 5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:26,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 14:09:26,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:26,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2b6db698a94e75a0672a0232a4488b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7k1h8pehbleuaolgkivr839i5m4qf7fi0kkc4m3ha25rr5mugqjacq6e16att8hd/family1/ff2b6db698a94e75a0672a0232a4488b 2023-07-11 14:09:26,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7k1h8pehbleuaolgkivr839i5m4qf7fi0kkc4m3ha25rr5mugqjacq6e16att8hd/family1/ff2b6db698a94e75a0672a0232a4488b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_ 2023-07-11 14:09:26,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7k1h8pehbleuaolgkivr839i5m4qf7fi0kkc4m3ha25rr5mugqjacq6e16att8hd/family1/ff2b6db698a94e75a0672a0232a4488b into 5468830e11f70f9b65ff569cddc29953/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_ - updating store file list. 2023-07-11 14:09:26,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_ into 5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:26,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7k1h8pehbleuaolgkivr839i5m4qf7fi0kkc4m3ha25rr5mugqjacq6e16att8hd/family1/ff2b6db698a94e75a0672a0232a4488b into 5468830e11f70f9b65ff569cddc29953/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_) 2023-07-11 14:09:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7k1h8pehbleuaolgkivr839i5m4qf7fi0kkc4m3ha25rr5mugqjacq6e16att8hd/family1/ff2b6db698a94e75a0672a0232a4488b 2023-07-11 14:09:26,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 14:09:26,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 14:09:26,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): 5468830e11f70f9b65ff569cddc29953/family1 is initiating minor compaction 2023-07-11 14:09:26,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4d5f0b62; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:26,469 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5468830e11f70f9b65ff569cddc29953/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:26,469 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/de0e8a0ae17048d0b6cdd1b5267109fd, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/a313b77cbd3d4d07b7daf7b2afbd81d3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/340270d162744eefb1afe5feb4e84e4b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/bd30622ea13e4923b38fa136e0b2ccf6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0c27fcf3978b42eb90d1d581fc4e3098, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/c349e0928bbc421bbf12ea7592fff101, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/770988f586974d468c889c3ebefa0d50, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/39cbcd36918f43c3ae4a6476dee9301c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0a1456205e754b359a8e2b139e72ddd4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp, totalSize=50.2 K 2023-07-11 14:09:26,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting de0e8a0ae17048d0b6cdd1b5267109fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:09:26,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting a313b77cbd3d4d07b7daf7b2afbd81d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:09:26,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 340270d162744eefb1afe5feb4e84e4b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 14:09:26,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting bd30622ea13e4923b38fa136e0b2ccf6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 14:09:26,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 0c27fcf3978b42eb90d1d581fc4e3098, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 14:09:26,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting c349e0928bbc421bbf12ea7592fff101, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 14:09:26,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 770988f586974d468c889c3ebefa0d50, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 14:09:26,471 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 39cbcd36918f43c3ae4a6476dee9301c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 14:09:26,471 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 0a1456205e754b359a8e2b139e72ddd4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 14:09:26,471 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting acfc02e6018544078469bec48851e8f2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 14:09:26,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:26,489 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:26,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280ac73d0a36164478af4dbcf6e2612e30 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280ac73d0a36164478af4dbcf6e2612e30 2023-07-11 14:09:26,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512316e972e5c99a540cd89dbdec4b611b073 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512316e972e5c99a540cd89dbdec4b611b073 2023-07-11 14:09:26,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016eec4808e61e40f09146db192a98a28f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016eec4808e61e40f09146db192a98a28f 2023-07-11 14:09:26,501 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010352076cf7096e427cb356d1515e76f47a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010352076cf7096e427cb356d1515e76f47a 2023-07-11 14:09:26,502 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-07-11 14:09:26,502 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 14:09:26,502 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,502 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:26,553 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5468830e11f70f9b65ff569cddc29953#family1#compaction#10 average throughput is 0.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:27,038 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053159e9e421f045dbab2495e162095521 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512053159e9e421f045dbab2495e162095521 2023-07-11 14:09:27,039 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:27,089 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99c2d0e60aa7474ca568390da9369ab2 first=Optional[r00] last=Optional[r2] 2023-07-11 14:09:27,091 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99c2d0e60aa7474ca568390da9369ab2}] 2023-07-11 14:09:27,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99c2d0e60aa7474ca568390da9369ab2 for inclusion in 5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:27,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 14:09:27,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:27,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:27,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99c2d0e60aa7474ca568390da9369ab2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1p8bg4thtorcojol59ut8vhteo6d96nbri0jjk0fs4ufknp4qf7d2ab8n3vafhd8/family1/99c2d0e60aa7474ca568390da9369ab2 2023-07-11 14:09:27,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1p8bg4thtorcojol59ut8vhteo6d96nbri0jjk0fs4ufknp4qf7d2ab8n3vafhd8/family1/99c2d0e60aa7474ca568390da9369ab2 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_ 2023-07-11 14:09:27,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1p8bg4thtorcojol59ut8vhteo6d96nbri0jjk0fs4ufknp4qf7d2ab8n3vafhd8/family1/99c2d0e60aa7474ca568390da9369ab2 into 5468830e11f70f9b65ff569cddc29953/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_ - updating store file list. 2023-07-11 14:09:27,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_ into 5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:27,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1p8bg4thtorcojol59ut8vhteo6d96nbri0jjk0fs4ufknp4qf7d2ab8n3vafhd8/family1/99c2d0e60aa7474ca568390da9369ab2 into 5468830e11f70f9b65ff569cddc29953/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_) 2023-07-11 14:09:27,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1p8bg4thtorcojol59ut8vhteo6d96nbri0jjk0fs4ufknp4qf7d2ab8n3vafhd8/family1/99c2d0e60aa7474ca568390da9369ab2 2023-07-11 14:09:27,118 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:27,121 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:27,123 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b20b10b8b96040d3aa9df8eee70b00bd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b20b10b8b96040d3aa9df8eee70b00bd 2023-07-11 14:09:27,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014c17c390bb214252b58af480e0dd4429 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014c17c390bb214252b58af480e0dd4429 2023-07-11 14:09:27,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fd191334833e45e989d5233b3f97182d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fd191334833e45e989d5233b3f97182d 2023-07-11 14:09:27,127 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-07-11 14:09:27,127 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 14:09:27,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:27,128 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:27,129 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:27,130 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 14:09:27,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 943 msec 2023-07-11 14:09:27,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 14:09:27,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:27,391 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/5ffb8df9fc78413aa1cbdea66932fda2 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/5ffb8df9fc78413aa1cbdea66932fda2 2023-07-11 14:09:27,407 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5468830e11f70f9b65ff569cddc29953/family1 of 5468830e11f70f9b65ff569cddc29953 into 5ffb8df9fc78413aa1cbdea66932fda2(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:27,407 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:27,408 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1689084566466; duration=0sec 2023-07-11 14:09:27,409 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:27,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/de0e8a0ae17048d0b6cdd1b5267109fd, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/a313b77cbd3d4d07b7daf7b2afbd81d3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/340270d162744eefb1afe5feb4e84e4b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/bd30622ea13e4923b38fa136e0b2ccf6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0c27fcf3978b42eb90d1d581fc4e3098, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/c349e0928bbc421bbf12ea7592fff101, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/770988f586974d468c889c3ebefa0d50, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/39cbcd36918f43c3ae4a6476dee9301c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0a1456205e754b359a8e2b139e72ddd4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_] to archive 2023-07-11 14:09:27,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:27,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/de0e8a0ae17048d0b6cdd1b5267109fd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/de0e8a0ae17048d0b6cdd1b5267109fd 2023-07-11 14:09:27,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/a313b77cbd3d4d07b7daf7b2afbd81d3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/a313b77cbd3d4d07b7daf7b2afbd81d3 2023-07-11 14:09:27,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/340270d162744eefb1afe5feb4e84e4b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/340270d162744eefb1afe5feb4e84e4b 2023-07-11 14:09:27,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/bd30622ea13e4923b38fa136e0b2ccf6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/bd30622ea13e4923b38fa136e0b2ccf6 2023-07-11 14:09:27,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0c27fcf3978b42eb90d1d581fc4e3098 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0c27fcf3978b42eb90d1d581fc4e3098 2023-07-11 14:09:27,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/c349e0928bbc421bbf12ea7592fff101 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/c349e0928bbc421bbf12ea7592fff101 2023-07-11 14:09:27,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/770988f586974d468c889c3ebefa0d50 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/770988f586974d468c889c3ebefa0d50 2023-07-11 14:09:27,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/39cbcd36918f43c3ae4a6476dee9301c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/39cbcd36918f43c3ae4a6476dee9301c 2023-07-11 14:09:27,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0a1456205e754b359a8e2b139e72ddd4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/0a1456205e754b359a8e2b139e72ddd4 2023-07-11 14:09:27,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/acfc02e6018544078469bec48851e8f2_SeqId_44_ 2023-07-11 14:09:27,728 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-07-11 14:09:27,731 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:27,731 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-07-11 14:09:27,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-07-11 14:09:27,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, REOPEN/MOVE}] 2023-07-11 14:09:27,757 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, REOPEN/MOVE 2023-07-11 14:09:27,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5468830e11f70f9b65ff569cddc29953, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:27,758 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689084567758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084567758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084567758"}]},"ts":"1689084567758"} 2023-07-11 14:09:27,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 5468830e11f70f9b65ff569cddc29953, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:27,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:27,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5468830e11f70f9b65ff569cddc29953, disabling compactions & flushes 2023-07-11 14:09:27,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:27,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:27,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. after waiting 0 ms 2023-07-11 14:09:27,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:27,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-07-11 14:09:27,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:27,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:27,944 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 5468830e11f70f9b65ff569cddc29953 to self. 2023-07-11 14:09:27,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:27,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5468830e11f70f9b65ff569cddc29953, regionState=CLOSED 2023-07-11 14:09:27,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689084567947"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084567947"}]},"ts":"1689084567947"} 2023-07-11 14:09:27,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-11 14:09:27,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 5468830e11f70f9b65ff569cddc29953, server=jenkins-hbase9.apache.org,46743,1689084553537 in 188 msec 2023-07-11 14:09:27,952 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=true 2023-07-11 14:09:28,103 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5468830e11f70f9b65ff569cddc29953, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:28,103 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689084568103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084568103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084568103"}]},"ts":"1689084568103"} 2023-07-11 14:09:28,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 5468830e11f70f9b65ff569cddc29953, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:28,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:28,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5468830e11f70f9b65ff569cddc29953, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:28,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:28,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:28,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:28,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:28,266 INFO [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:28,267 DEBUG [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:28,267 DEBUG [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:28,268 INFO [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5468830e11f70f9b65ff569cddc29953 columnFamilyName family1 2023-07-11 14:09:28,278 DEBUG [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_ 2023-07-11 14:09:28,284 DEBUG [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/5ffb8df9fc78413aa1cbdea66932fda2 2023-07-11 14:09:28,289 DEBUG [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67034c0689414aaa98e8a2e440b4ab26 2023-07-11 14:09:28,290 INFO [StoreOpener-5468830e11f70f9b65ff569cddc29953-1] regionserver.HStore(310): Store=5468830e11f70f9b65ff569cddc29953/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:28,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:28,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:28,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:09:28,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5468830e11f70f9b65ff569cddc29953; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69412054, jitterRate=0.03432020545005798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:09:28,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:28,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953., pid=17, masterSystemTime=1689084568259 2023-07-11 14:09:28,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:28,301 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 14:09:28,303 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 14:09:28,303 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1912): 5468830e11f70f9b65ff569cddc29953/family1 is initiating minor compaction (all files) 2023-07-11 14:09:28,303 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5468830e11f70f9b65ff569cddc29953/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:28,303 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67034c0689414aaa98e8a2e440b4ab26, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/5ffb8df9fc78413aa1cbdea66932fda2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp, totalSize=358.6 K 2023-07-11 14:09:28,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:28,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:09:28,304 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 67034c0689414aaa98e8a2e440b4ab26, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878818110 2023-07-11 14:09:28,305 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 5ffb8df9fc78413aa1cbdea66932fda2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621218110 2023-07-11 14:09:28,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5468830e11f70f9b65ff569cddc29953, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:28,305 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689084568305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084568305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084568305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084568305"}]},"ts":"1689084568305"} 2023-07-11 14:09:28,305 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 2b9580ca23c24552a9fdfee813754473_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878818110 2023-07-11 14:09:28,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-07-11 14:09:28,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 5468830e11f70f9b65ff569cddc29953, server=jenkins-hbase9.apache.org,46743,1689084553537 in 202 msec 2023-07-11 14:09:28,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-11 14:09:28,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5468830e11f70f9b65ff569cddc29953, REOPEN/MOVE in 558 msec 2023-07-11 14:09:28,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-11 14:09:28,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 580 msec 2023-07-11 14:09:28,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0170 sec 2023-07-11 14:09:28,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-07-11 14:09:28,337 INFO [Listener at localhost/44533] compactions.TestMobCompactor(278): alter status finished 2023-07-11 14:09:28,339 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 14:09:28,342 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 14:09:28,342 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5468830e11f70f9b65ff569cddc29953#family1#compaction#11 average throughput is 6.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:28,347 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 14:09:28,353 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085168353 2023-07-11 14:09:28,354 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:28,355 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:09:28,356 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-07-11 14:09:28,356 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:28,357 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x6b4293c8 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:28,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f9f4eed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:28,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,425 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/.tmp/family1/005117ce937e42479f88346660886ffe as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/005117ce937e42479f88346660886ffe 2023-07-11 14:09:28,451 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5468830e11f70f9b65ff569cddc29953/family1 of 5468830e11f70f9b65ff569cddc29953 into 005117ce937e42479f88346660886ffe(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:28,451 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:28,451 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953., storeName=5468830e11f70f9b65ff569cddc29953/family1, priority=13, startTime=1689084568299; duration=0sec 2023-07-11 14:09:28,452 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:28,506 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112827ddf9f9b0cb4c2da628e19671fbfd0a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112827ddf9f9b0cb4c2da628e19671fbfd0a 2023-07-11 14:09:28,507 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:28,526 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:28,527 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:28,540 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:09:28,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67034c0689414aaa98e8a2e440b4ab26, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/5ffb8df9fc78413aa1cbdea66932fda2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_] to archive 2023-07-11 14:09:28,548 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:09:28,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:28,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67034c0689414aaa98e8a2e440b4ab26 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67034c0689414aaa98e8a2e440b4ab26 2023-07-11 14:09:28,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/5ffb8df9fc78413aa1cbdea66932fda2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/5ffb8df9fc78413aa1cbdea66932fda2 2023-07-11 14:09:28,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/2b9580ca23c24552a9fdfee813754473_SeqId_46_ 2023-07-11 14:09:28,599 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb324e67a5cd4d3682fe5f53322a6ead first=Optional[r05] last=Optional[r8] 2023-07-11 14:09:28,600 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=50 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb324e67a5cd4d3682fe5f53322a6ead}] 2023-07-11 14:09:28,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb324e67a5cd4d3682fe5f53322a6ead for inclusion in 5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-11 14:09:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:09:28,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb324e67a5cd4d3682fe5f53322a6ead to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__58bjkpil08oa4bd6t0mqmc2mjvnerh5fb706t8aeb3rulgtvtob96qttf9tlpm4d/family1/bb324e67a5cd4d3682fe5f53322a6ead 2023-07-11 14:09:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__58bjkpil08oa4bd6t0mqmc2mjvnerh5fb706t8aeb3rulgtvtob96qttf9tlpm4d/family1/bb324e67a5cd4d3682fe5f53322a6ead as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67e3b235d065454894958b1771c7fe4c_SeqId_53_ 2023-07-11 14:09:28,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__58bjkpil08oa4bd6t0mqmc2mjvnerh5fb706t8aeb3rulgtvtob96qttf9tlpm4d/family1/bb324e67a5cd4d3682fe5f53322a6ead into 5468830e11f70f9b65ff569cddc29953/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67e3b235d065454894958b1771c7fe4c_SeqId_53_ - updating store file list. 2023-07-11 14:09:28,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67e3b235d065454894958b1771c7fe4c_SeqId_53_ into 5468830e11f70f9b65ff569cddc29953/family1 2023-07-11 14:09:28,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__58bjkpil08oa4bd6t0mqmc2mjvnerh5fb706t8aeb3rulgtvtob96qttf9tlpm4d/family1/bb324e67a5cd4d3682fe5f53322a6ead into 5468830e11f70f9b65ff569cddc29953/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/family1/67e3b235d065454894958b1771c7fe4c_SeqId_53_) 2023-07-11 14:09:28,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__58bjkpil08oa4bd6t0mqmc2mjvnerh5fb706t8aeb3rulgtvtob96qttf9tlpm4d/family1/bb324e67a5cd4d3682fe5f53322a6ead 2023-07-11 14:09:28,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:28,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:28,639 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112065a75146cb594b42a536f8786e536193 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112065a75146cb594b42a536f8786e536193 2023-07-11 14:09:28,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c2e54c19c46f4ffc961d161d88406148 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c2e54c19c46f4ffc961d161d88406148 2023-07-11 14:09:28,641 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-07-11 14:09:28,641 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 14:09:28,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 14:09:28,642 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 14:09:28,642 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:28,643 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 14:09:28,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 303 msec 2023-07-11 14:09:28,809 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=254 (was 213) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50826 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:51064 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50758 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50902 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x402d72ae-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x3852d21a-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x5263849a-shared-pool-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x6b4293c8-SendThread(127.0.0.1:63702) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RS:0;jenkins-hbase9:46743-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x89c43a5-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x402d72ae-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50888 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x89c43a5-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50952 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50900 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x6b4293c8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1887029990.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-513130931_17 at /127.0.0.1:50940 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x402d72ae-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x89c43a5-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50896 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50798 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50954 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x6b4293c8-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50968 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50988 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x402d72ae-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x402d72ae-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50872 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x3852d21a-SendThread(127.0.0.1:63702) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50726 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50856 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x3852d21a sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1887029990.run(Unknown Source) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=608 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=700 (was 734), ProcessCount=175 (was 175), AvailableMemoryMB=1536 (was 1773) 2023-07-11 14:09:28,828 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=254, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=700, ProcessCount=175, AvailableMemoryMB=1535 2023-07-11 14:09:28,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 14:09:28,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:28,835 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:09:28,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-07-11 14:09:28,836 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:09:28,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 14:09:28,839 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:28,840 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050 empty. 2023-07-11 14:09:28,840 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:28,840 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-07-11 14:09:28,857 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:28,859 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 46718097f9c05e645861136a4a7a8050, NAME => 'testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:28,885 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:28,885 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 46718097f9c05e645861136a4a7a8050, disabling compactions & flushes 2023-07-11 14:09:28,885 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:28,885 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:28,885 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. after waiting 0 ms 2023-07-11 14:09:28,885 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:28,885 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:28,886 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:28,889 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:09:28,890 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689084568890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084568890"}]},"ts":"1689084568890"} 2023-07-11 14:09:28,892 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:09:28,893 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:09:28,894 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084568894"}]},"ts":"1689084568894"} 2023-07-11 14:09:28,895 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-07-11 14:09:28,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 14:09:29,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=46718097f9c05e645861136a4a7a8050, ASSIGN}] 2023-07-11 14:09:29,016 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=46718097f9c05e645861136a4a7a8050, ASSIGN 2023-07-11 14:09:29,018 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=46718097f9c05e645861136a4a7a8050, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:29,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 14:09:29,169 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=46718097f9c05e645861136a4a7a8050, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:29,169 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689084569169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084569169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084569169"}]},"ts":"1689084569169"} 2023-07-11 14:09:29,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 46718097f9c05e645861136a4a7a8050, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:29,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:29,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46718097f9c05e645861136a4a7a8050, NAME => 'testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:29,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:29,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:29,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:29,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:29,335 INFO [StoreOpener-46718097f9c05e645861136a4a7a8050-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:29,342 DEBUG [StoreOpener-46718097f9c05e645861136a4a7a8050-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:29,342 DEBUG [StoreOpener-46718097f9c05e645861136a4a7a8050-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:29,343 INFO [StoreOpener-46718097f9c05e645861136a4a7a8050-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46718097f9c05e645861136a4a7a8050 columnFamilyName family1 2023-07-11 14:09:29,345 INFO [StoreOpener-46718097f9c05e645861136a4a7a8050-1] regionserver.HStore(310): Store=46718097f9c05e645861136a4a7a8050/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:29,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:29,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:29,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 46718097f9c05e645861136a4a7a8050 2023-07-11 14:09:29,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:29,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 46718097f9c05e645861136a4a7a8050; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69961397, jitterRate=0.042506054043769836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:09:29,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:29,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050., pid=21, masterSystemTime=1689084569325 2023-07-11 14:09:29,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:29,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:29,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=46718097f9c05e645861136a4a7a8050, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:29,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689084569361"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084569361"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084569361"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084569361"}]},"ts":"1689084569361"} 2023-07-11 14:09:29,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-07-11 14:09:29,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 46718097f9c05e645861136a4a7a8050, server=jenkins-hbase9.apache.org,46743,1689084553537 in 194 msec 2023-07-11 14:09:29,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-11 14:09:29,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=46718097f9c05e645861136a4a7a8050, ASSIGN in 356 msec 2023-07-11 14:09:29,376 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:09:29,377 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084569377"}]},"ts":"1689084569377"} 2023-07-11 14:09:29,383 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-07-11 14:09:29,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 14:09:29,454 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:09:29,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 623 msec 2023-07-11 14:09:29,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 14:09:29,944 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-07-11 14:09:29,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:29,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:29,984 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:29,985 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:29,985 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:29,985 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:29,986 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:29,986 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,029 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:30,029 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:30,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,030 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:30,030 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:30,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:30,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,032 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:30,032 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:30,032 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:30,033 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:30,033 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:30,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:30,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:30,034 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 14:09:30,515 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301f157ed7cb1744558390527a467bc39d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511301f157ed7cb1744558390527a467bc39d 2023-07-11 14:09:30,920 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/cd95ec9e005746ddb3053238cf24194d 2023-07-11 14:09:30,927 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/cd95ec9e005746ddb3053238cf24194d as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/cd95ec9e005746ddb3053238cf24194d 2023-07-11 14:09:30,933 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/cd95ec9e005746ddb3053238cf24194d, entries=1000, sequenceid=5, filesize=166.0 K 2023-07-11 14:09:30,935 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 901ms, sequenceid=5, compaction requested=false 2023-07-11 14:09:30,935 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:30,936 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:30,936 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:30,936 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:30,936 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:30,936 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:30,936 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:30,936 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:30,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:30,951 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:30,952 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,952 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:30,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:30,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57aa411f[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:30,954 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:30,954 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,982 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:30,982 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:30,982 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:30,982 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:30,982 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:30,983 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:31,036 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:31,036 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,036 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:31,037 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:31,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:31,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:31,041 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:31,041 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:31,041 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:31,041 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,041 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:31,069 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,070 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,070 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:31,071 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,073 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,113 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:31,113 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,113 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:31,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:31,113 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:31,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:31,113 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:31,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:31,115 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,115 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,115 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,115 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:31,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:31,115 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,115 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:31,115 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:31,215 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:31,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:31,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:31,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:31,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,225 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:31,225 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:31,226 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:31,226 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:31,227 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,227 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,228 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:31,228 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:31,228 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,228 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,229 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,230 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:31,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,230 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:31,230 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:31,230 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:31,231 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:31,231 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:31,231 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:31,231 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:31,231 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 14:09:31,649 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128092f5c1ca3864288b21cee3e7d02e470 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128092f5c1ca3864288b21cee3e7d02e470 2023-07-11 14:09:31,655 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/e7ca08cc815c47a7b03b3703d6643900 2023-07-11 14:09:31,661 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/e7ca08cc815c47a7b03b3703d6643900 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/e7ca08cc815c47a7b03b3703d6643900 2023-07-11 14:09:31,667 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/e7ca08cc815c47a7b03b3703d6643900, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 14:09:31,668 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 437ms, sequenceid=9, compaction requested=false 2023-07-11 14:09:31,668 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:31,668 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:31,668 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:31,668 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:31,668 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,668 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:31,668 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:31,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,670 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:31,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:31,671 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,671 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:31,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:31,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:31,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:31,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aa4a7ce[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:31,672 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:31,673 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,674 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:31,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:31,674 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:31,674 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,674 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:31,676 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:31,676 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,676 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:31,676 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:31,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:31,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:31,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:31,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:31,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:31,679 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:31,679 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:31,679 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:31,679 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,679 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:31,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:31,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:31,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:31,681 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,683 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,696 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,696 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:31,696 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,697 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:31,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:31,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:31,697 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:31,697 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:31,697 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,698 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,698 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,698 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:31,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:31,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:31,698 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,698 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:31,798 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:31,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:31,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:31,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:31,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,807 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:31,807 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:31,808 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:31,808 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:31,809 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,809 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,810 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,810 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:31,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:31,810 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:31,810 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,811 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,811 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:31,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:31,811 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:31,811 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:31,812 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:31,812 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:31,812 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:31,812 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:31,812 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:31,812 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:32,228 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019baf9e1dcbba4cbb8ccc8bcae8c07586 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512019baf9e1dcbba4cbb8ccc8bcae8c07586 2023-07-11 14:09:32,234 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2d75eb20e6034b70afbe5a668bc3fa24 2023-07-11 14:09:32,240 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2d75eb20e6034b70afbe5a668bc3fa24 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2d75eb20e6034b70afbe5a668bc3fa24 2023-07-11 14:09:32,246 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2d75eb20e6034b70afbe5a668bc3fa24, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 14:09:32,247 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 435ms, sequenceid=13, compaction requested=true 2023-07-11 14:09:32,247 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:32,247 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:32,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:32,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:32,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:32,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:32,249 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:32,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:32,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9de25a3[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:32,251 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:32,251 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,252 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,252 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:32,252 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:32,253 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:32,253 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,253 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:32,255 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:32,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:32,259 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:32,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:32,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:32,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,259 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:32,260 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,260 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,261 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:32,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:32,261 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,263 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:32,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:32,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:32,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:32,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:32,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:32,266 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:32,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,266 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,267 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,267 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,267 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:32,267 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:32,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:32,367 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:32,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:32,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:32,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,376 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:32,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:32,377 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:32,377 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:32,378 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,378 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,379 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,379 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:32,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:32,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:32,379 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:32,379 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:32,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:32,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,380 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,381 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:32,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:32,381 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:32,381 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:32,381 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:32,382 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:32,382 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:32,382 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:32,382 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:32,382 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:32,798 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053abdd5e5daca42f493837ccf91281394 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053abdd5e5daca42f493837ccf91281394 2023-07-11 14:09:33,204 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2f648c806a794ae9a9fdfed15f243fe9 2023-07-11 14:09:33,211 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2f648c806a794ae9a9fdfed15f243fe9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2f648c806a794ae9a9fdfed15f243fe9 2023-07-11 14:09:33,216 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2f648c806a794ae9a9fdfed15f243fe9, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 14:09:33,217 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 835ms, sequenceid=17, compaction requested=true 2023-07-11 14:09:33,217 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:33,217 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:33,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:33,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:33,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:33,218 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:33,220 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,220 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:33,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:33,220 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,220 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:33,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:33,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:33,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:33,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:33,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42822d5b[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:33,222 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:33,222 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,223 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,223 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:33,223 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:33,223 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:33,224 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,224 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:33,225 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:33,225 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,225 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:33,225 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:33,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:33,228 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:33,228 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:33,228 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:33,228 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,228 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:33,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:33,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:33,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:33,230 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,232 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:33,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:33,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:33,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:33,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:33,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,237 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:33,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,238 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:33,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:33,238 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:33,338 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:33,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:33,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:33,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,348 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:33,348 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:33,349 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:33,349 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:33,349 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,349 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,351 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:33,351 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:33,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:33,351 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,351 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:33,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:33,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,352 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,352 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:33,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,352 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:33,352 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:33,353 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:33,353 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:33,353 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:33,353 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:33,353 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:33,353 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:33,486 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:09:33,772 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f37858b4386043f9b9ad8977378104c5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f37858b4386043f9b9ad8977378104c5 2023-07-11 14:09:33,778 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/abde8a2437e14491ab322807742c8dbd 2023-07-11 14:09:33,783 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/abde8a2437e14491ab322807742c8dbd as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/abde8a2437e14491ab322807742c8dbd 2023-07-11 14:09:33,789 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/abde8a2437e14491ab322807742c8dbd, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 14:09:33,790 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 437ms, sequenceid=21, compaction requested=true 2023-07-11 14:09:33,790 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:33,790 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:33,790 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:33,790 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:33,790 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,790 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:33,790 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:33,792 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:33,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:33,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,793 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:33,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:33,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47a52ead[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:33,795 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:33,795 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,796 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,796 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:33,796 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:33,796 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:33,797 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,797 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:33,799 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:33,799 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,799 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:33,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:33,799 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:33,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:33,802 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:33,802 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:33,802 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:33,802 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,802 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:33,807 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,807 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:33,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:33,807 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:33,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,808 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:33,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,809 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,812 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:33,812 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:33,812 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:33,812 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:33,812 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:33,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:33,812 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:33,812 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:33,813 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:33,813 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,813 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:33,814 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,814 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,914 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:33,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:33,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:33,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:33,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,930 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:33,930 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:33,930 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:33,930 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:33,931 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,931 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,938 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,938 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:33,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:33,938 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:33,939 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:33,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:33,940 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:33,940 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:33,941 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:33,941 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:33,941 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:33,941 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:33,942 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:33,942 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:33,967 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123120cc86da4c424e4786dd02e6a14b45a4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123120cc86da4c424e4786dd02e6a14b45a4 2023-07-11 14:09:34,375 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a 2023-07-11 14:09:34,382 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a 2023-07-11 14:09:34,389 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 14:09:34,390 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 448ms, sequenceid=25, compaction requested=true 2023-07-11 14:09:34,391 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:34,391 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:34,391 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:34,391 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:34,391 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,391 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:34,391 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:34,393 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,393 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,393 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,394 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:34,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:34,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28506b40[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:34,396 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:34,396 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,397 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,397 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:34,397 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:34,398 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:34,398 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,398 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:34,399 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,399 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:34,399 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,399 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:34,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:34,403 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:34,403 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:34,403 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:34,403 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,403 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:34,406 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,406 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,406 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:34,407 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,409 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,413 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:34,413 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,413 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,413 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:34,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:34,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:34,413 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:34,413 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,413 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,417 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:34,417 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:34,417 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:34,417 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:34,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:34,417 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,517 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:34,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:34,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:34,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:34,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,531 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:34,531 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:34,532 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:34,532 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:34,533 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,533 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:34,535 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:34,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:34,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,536 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,536 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:34,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:34,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,536 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,537 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:34,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,538 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:34,538 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:34,538 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:34,539 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:34,539 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:34,539 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:34,539 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:34,539 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:34,583 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015ed043c39c454cbe8ef1856c4dbd3cc4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601015ed043c39c454cbe8ef1856c4dbd3cc4 2023-07-11 14:09:34,603 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/ed51c0a7449d4df78d632c40b839b9e6 2023-07-11 14:09:34,612 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/ed51c0a7449d4df78d632c40b839b9e6 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/ed51c0a7449d4df78d632c40b839b9e6 2023-07-11 14:09:34,621 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/ed51c0a7449d4df78d632c40b839b9e6, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 14:09:34,623 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 84ms, sequenceid=29, compaction requested=true 2023-07-11 14:09:34,623 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:34,623 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:34,623 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:34,623 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:34,623 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,623 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:34,623 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:34,625 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,625 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,626 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,626 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:34,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50dba0d4[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:34,628 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:34,629 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,631 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,631 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:34,631 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:34,631 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:34,631 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,631 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:34,633 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,633 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:34,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,633 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:34,633 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:34,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:34,637 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:34,637 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:34,637 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:34,637 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,637 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:34,639 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,639 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,639 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,641 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,643 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,646 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:34,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:34,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:34,646 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,646 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,646 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,646 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,646 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,647 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:34,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:34,647 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,647 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:34,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:34,647 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:34,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:34,648 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:34,648 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:34,748 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:34,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:34,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:34,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:34,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,782 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:34,782 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:34,783 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:34,783 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:34,783 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,783 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,786 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:34,786 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:34,786 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,786 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,788 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:34,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,788 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:34,788 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:34,789 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:34,789 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:34,789 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:34,790 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:34,790 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:34,790 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:34,829 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039aad46fad27a4b92a125793ba0a25f54 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039aad46fad27a4b92a125793ba0a25f54 2023-07-11 14:09:34,844 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/48ee3f2be7bc465d97eac18ef034dec2 2023-07-11 14:09:34,858 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/48ee3f2be7bc465d97eac18ef034dec2 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/48ee3f2be7bc465d97eac18ef034dec2 2023-07-11 14:09:34,867 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/48ee3f2be7bc465d97eac18ef034dec2, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 14:09:34,869 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 79ms, sequenceid=33, compaction requested=true 2023-07-11 14:09:34,869 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:34,869 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:34,869 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:34,869 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:34,869 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,869 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:34,869 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:34,871 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,871 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,871 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,872 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:34,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:34,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e0b761[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:34,874 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:34,874 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,875 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:34,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:34,875 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,876 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:34,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:34,882 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:34,882 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:34,882 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:34,882 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:34,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:34,886 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:34,886 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:34,886 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:34,886 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,886 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:34,888 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,888 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:34,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,890 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:34,891 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:34,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,896 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:34,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,902 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:34,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:34,904 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:34,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:34,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:34,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:34,905 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:34,905 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:35,005 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:35,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:35,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:35,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:35,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,017 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:35,018 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:35,018 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:35,018 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:35,019 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,019 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,020 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,020 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:35,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:35,021 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,021 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:35,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:35,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,022 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:35,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,023 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:35,023 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:35,023 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:35,023 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:35,024 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:35,024 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:35,024 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:35,024 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:35,040 WARN [DataStreamer for file /user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907684953b77fd448b79141a49aa08e5071] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 14:09:35,049 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907684953b77fd448b79141a49aa08e5071 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907684953b77fd448b79141a49aa08e5071 2023-07-11 14:09:35,060 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/33e6fbfc18984174bef7621036cf1742 2023-07-11 14:09:35,068 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/33e6fbfc18984174bef7621036cf1742 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/33e6fbfc18984174bef7621036cf1742 2023-07-11 14:09:35,076 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/33e6fbfc18984174bef7621036cf1742, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 14:09:35,081 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 57ms, sequenceid=37, compaction requested=true 2023-07-11 14:09:35,082 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:35,082 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:35,082 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:35,082 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:35,082 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,082 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:35,082 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:35,093 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,093 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:35,094 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,094 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:35,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:35,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d5e31f6[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:35,096 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:35,096 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,098 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,098 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,098 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:35,098 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:35,098 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:35,099 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:35,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:35,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:35,100 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:35,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:35,104 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:35,104 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:35,104 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:35,104 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,104 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:35,106 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,106 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:35,106 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:35,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,107 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:35,109 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:35,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:35,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:35,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:35,118 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:35,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:35,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:35,118 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:35,119 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:35,219 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:35,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:35,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:35,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:35,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,230 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:35,230 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:35,230 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:09:35,230 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:35,231 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,231 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,232 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,232 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:35,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:35,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:35,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:35,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:35,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,234 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,234 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:09:35,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,234 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:09:35,234 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:35,236 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:09:35,236 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:35,236 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:35,236 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:35,236 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. started... 2023-07-11 14:09:35,236 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46718097f9c05e645861136a4a7a8050 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:35,257 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200c1a11adc188421681ba90d2dab201b8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200c1a11adc188421681ba90d2dab201b8 2023-07-11 14:09:35,265 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2b624d460ea64e6e81cd650ad4e1260b 2023-07-11 14:09:35,272 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/2b624d460ea64e6e81cd650ad4e1260b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2b624d460ea64e6e81cd650ad4e1260b 2023-07-11 14:09:35,284 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2b624d460ea64e6e81cd650ad4e1260b, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 14:09:35,286 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 46718097f9c05e645861136a4a7a8050 in 50ms, sequenceid=41, compaction requested=true 2023-07-11 14:09:35,286 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:35,286 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:35,286 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:35,286 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:35,286 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,286 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:09:35,286 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:09:35,291 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,291 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:35,291 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,291 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:35,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:09:35,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46ff4d76[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:35,293 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:35,294 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,296 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:35,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:09:35,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:35,296 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,297 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:35,298 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,298 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:09:35,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,298 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:35,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:35,298 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:09:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:35,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:35,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:35,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:35,302 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:09:35,302 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:35,302 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:35,302 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,302 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:35,309 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,309 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:35,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:35,309 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:35,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,310 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:35,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:35,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:35,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:35,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,311 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:35,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,320 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:35,320 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,320 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:35,320 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,320 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:35,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:35,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 14:09:35,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:35,320 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:09:35,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:35,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,321 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:35,321 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:35,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:35,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:35,421 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:35,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:35,425 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-07-11 14:09:35,427 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:35,428 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:35,429 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:35,429 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085175429 2023-07-11 14:09:35,430 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:09:35,432 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-07-11 14:09:35,432 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:35,433 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x3e07f602 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:35,448 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bea2f09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:35,448 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:35,530 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fa21d84c8b3a44ea91d6ff3573c3308d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fa21d84c8b3a44ea91d6ff3573c3308d 2023-07-11 14:09:35,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:35,556 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:35,558 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:35,578 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:09:35,582 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:09:35,602 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5f1fc477b68b42c4ac59feb95c07a34c first=Optional[r5] last=Optional[r6] 2023-07-11 14:09:35,603 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5f1fc477b68b42c4ac59feb95c07a34c}] 2023-07-11 14:09:35,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5f1fc477b68b42c4ac59feb95c07a34c for inclusion in 46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:35,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-07-11 14:09:35,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:35,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:35,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5f1fc477b68b42c4ac59feb95c07a34c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2t4rpvv413de0kn01lpg2t0bboc3rq0nit7sobks5oj2g954bpdn4rpeooj5t66s/family1/5f1fc477b68b42c4ac59feb95c07a34c 2023-07-11 14:09:35,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2t4rpvv413de0kn01lpg2t0bboc3rq0nit7sobks5oj2g954bpdn4rpeooj5t66s/family1/5f1fc477b68b42c4ac59feb95c07a34c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_ 2023-07-11 14:09:35,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2t4rpvv413de0kn01lpg2t0bboc3rq0nit7sobks5oj2g954bpdn4rpeooj5t66s/family1/5f1fc477b68b42c4ac59feb95c07a34c into 46718097f9c05e645861136a4a7a8050/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_ - updating store file list. 2023-07-11 14:09:35,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_ into 46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:35,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2t4rpvv413de0kn01lpg2t0bboc3rq0nit7sobks5oj2g954bpdn4rpeooj5t66s/family1/5f1fc477b68b42c4ac59feb95c07a34c into 46718097f9c05e645861136a4a7a8050/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_) 2023-07-11 14:09:35,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2t4rpvv413de0kn01lpg2t0bboc3rq0nit7sobks5oj2g954bpdn4rpeooj5t66s/family1/5f1fc477b68b42c4ac59feb95c07a34c 2023-07-11 14:09:35,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 14:09:35,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 14:09:35,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): 46718097f9c05e645861136a4a7a8050/family1 is initiating minor compaction 2023-07-11 14:09:35,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@41a5b01; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:35,635 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 46718097f9c05e645861136a4a7a8050/family1 in testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:35,635 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/e7ca08cc815c47a7b03b3703d6643900, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2d75eb20e6034b70afbe5a668bc3fa24, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2f648c806a794ae9a9fdfed15f243fe9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/abde8a2437e14491ab322807742c8dbd, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/ed51c0a7449d4df78d632c40b839b9e6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/48ee3f2be7bc465d97eac18ef034dec2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/33e6fbfc18984174bef7621036cf1742, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2b624d460ea64e6e81cd650ad4e1260b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp, totalSize=49.7 K 2023-07-11 14:09:35,635 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting e7ca08cc815c47a7b03b3703d6643900, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:09:35,635 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 2d75eb20e6034b70afbe5a668bc3fa24, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:09:35,635 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 2f648c806a794ae9a9fdfed15f243fe9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 14:09:35,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting abde8a2437e14491ab322807742c8dbd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 14:09:35,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 2282e5dcfd1d4cf8afcf40bc81ab8b1a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 14:09:35,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting ed51c0a7449d4df78d632c40b839b9e6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 14:09:35,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 48ee3f2be7bc465d97eac18ef034dec2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 14:09:35,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 33e6fbfc18984174bef7621036cf1742, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 14:09:35,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 2b624d460ea64e6e81cd650ad4e1260b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 14:09:35,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 8d2330bf27444dc79faf75fef187905c_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 14:09:35,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:35,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:35,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601015ed043c39c454cbe8ef1856c4dbd3cc4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601015ed043c39c454cbe8ef1856c4dbd3cc4 2023-07-11 14:09:35,649 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039aad46fad27a4b92a125793ba0a25f54 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039aad46fad27a4b92a125793ba0a25f54 2023-07-11 14:09:35,649 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-07-11 14:09:35,649 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-07-11 14:09:35,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:35,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:35,722 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): 46718097f9c05e645861136a4a7a8050#family1#compaction#22 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:35,800 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:09:35,800 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b4293c8 to 127.0.0.1:63702 2023-07-11 14:09:35,800 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:09:35,803 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:09:35,803 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3852d21a to 127.0.0.1:63702 2023-07-11 14:09:35,803 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:09:36,154 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/d74ee0c58fb149f3b353efcf48940aea as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/d74ee0c58fb149f3b353efcf48940aea 2023-07-11 14:09:36,166 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 46718097f9c05e645861136a4a7a8050/family1 of 46718097f9c05e645861136a4a7a8050 into d74ee0c58fb149f3b353efcf48940aea(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:36,166 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:36,166 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1689084575634; duration=0sec 2023-07-11 14:09:36,166 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:36,216 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cd0cb299f6e14c6eb78bce1a6491312a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cd0cb299f6e14c6eb78bce1a6491312a 2023-07-11 14:09:36,217 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:36,246 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 first=Optional[r1] last=Optional[r4] 2023-07-11 14:09:36,247 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9e5d9e63481e4a8c9d26cb6dd03913f4}] 2023-07-11 14:09:36,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 for inclusion in 46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:36,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/e7ca08cc815c47a7b03b3703d6643900, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2d75eb20e6034b70afbe5a668bc3fa24, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2f648c806a794ae9a9fdfed15f243fe9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/abde8a2437e14491ab322807742c8dbd, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/ed51c0a7449d4df78d632c40b839b9e6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/48ee3f2be7bc465d97eac18ef034dec2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/33e6fbfc18984174bef7621036cf1742, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2b624d460ea64e6e81cd650ad4e1260b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_] to archive 2023-07-11 14:09:36,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-07-11 14:09:36,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:36,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:36,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g8tknio96b5e40a8b3oc8qsqb33f2bacp220obl6n05in5692udijea123bt8u8d/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 2023-07-11 14:09:36,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:36,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g8tknio96b5e40a8b3oc8qsqb33f2bacp220obl6n05in5692udijea123bt8u8d/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_ 2023-07-11 14:09:36,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g8tknio96b5e40a8b3oc8qsqb33f2bacp220obl6n05in5692udijea123bt8u8d/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 into 46718097f9c05e645861136a4a7a8050/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_ - updating store file list. 2023-07-11 14:09:36,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/e7ca08cc815c47a7b03b3703d6643900 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/e7ca08cc815c47a7b03b3703d6643900 2023-07-11 14:09:36,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2d75eb20e6034b70afbe5a668bc3fa24 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2d75eb20e6034b70afbe5a668bc3fa24 2023-07-11 14:09:36,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2f648c806a794ae9a9fdfed15f243fe9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2f648c806a794ae9a9fdfed15f243fe9 2023-07-11 14:09:36,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_ into 46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:36,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g8tknio96b5e40a8b3oc8qsqb33f2bacp220obl6n05in5692udijea123bt8u8d/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 into 46718097f9c05e645861136a4a7a8050/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_) 2023-07-11 14:09:36,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/abde8a2437e14491ab322807742c8dbd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/abde8a2437e14491ab322807742c8dbd 2023-07-11 14:09:36,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g8tknio96b5e40a8b3oc8qsqb33f2bacp220obl6n05in5692udijea123bt8u8d/family1/9e5d9e63481e4a8c9d26cb6dd03913f4 2023-07-11 14:09:36,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 14:09:36,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2282e5dcfd1d4cf8afcf40bc81ab8b1a 2023-07-11 14:09:36,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 14:09:36,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): 46718097f9c05e645861136a4a7a8050/family1 is initiating minor compaction (all files) 2023-07-11 14:09:36,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/ed51c0a7449d4df78d632c40b839b9e6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/ed51c0a7449d4df78d632c40b839b9e6 2023-07-11 14:09:36,295 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 46718097f9c05e645861136a4a7a8050/family1 in testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:09:36,296 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/cd95ec9e005746ddb3053238cf24194d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/d74ee0c58fb149f3b353efcf48940aea, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp, totalSize=178.1 K 2023-07-11 14:09:36,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@537317a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:36,298 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting cd95ec9e005746ddb3053238cf24194d, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878818110 2023-07-11 14:09:36,299 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting d74ee0c58fb149f3b353efcf48940aea, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621218110 2023-07-11 14:09:36,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/48ee3f2be7bc465d97eac18ef034dec2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/48ee3f2be7bc465d97eac18ef034dec2 2023-07-11 14:09:36,300 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965218110 2023-07-11 14:09:36,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/33e6fbfc18984174bef7621036cf1742 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/33e6fbfc18984174bef7621036cf1742 2023-07-11 14:09:36,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2b624d460ea64e6e81cd650ad4e1260b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/2b624d460ea64e6e81cd650ad4e1260b 2023-07-11 14:09:36,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/8d2330bf27444dc79faf75fef187905c_SeqId_44_ 2023-07-11 14:09:36,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:36,312 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:36,315 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512019baf9e1dcbba4cbb8ccc8bcae8c07586 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512019baf9e1dcbba4cbb8ccc8bcae8c07586 2023-07-11 14:09:36,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053abdd5e5daca42f493837ccf91281394 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053abdd5e5daca42f493837ccf91281394 2023-07-11 14:09:36,318 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f37858b4386043f9b9ad8977378104c5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f37858b4386043f9b9ad8977378104c5 2023-07-11 14:09:36,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123120cc86da4c424e4786dd02e6a14b45a4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123120cc86da4c424e4786dd02e6a14b45a4 2023-07-11 14:09:36,320 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-07-11 14:09:36,320 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-07-11 14:09:36,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:36,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:36,371 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): 46718097f9c05e645861136a4a7a8050#family1#compaction#23 average throughput is 3.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:36,424 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/.tmp/family1/3f6db46f19e046b3ac1d0ded8016d1d1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/3f6db46f19e046b3ac1d0ded8016d1d1 2023-07-11 14:09:36,440 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 46718097f9c05e645861136a4a7a8050/family1 of 46718097f9c05e645861136a4a7a8050 into 3f6db46f19e046b3ac1d0ded8016d1d1(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:36,440 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:36,440 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1689084576289; duration=0sec 2023-07-11 14:09:36,440 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:36,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/cd95ec9e005746ddb3053238cf24194d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/d74ee0c58fb149f3b353efcf48940aea, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_] to archive 2023-07-11 14:09:36,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:36,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/cd95ec9e005746ddb3053238cf24194d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/cd95ec9e005746ddb3053238cf24194d 2023-07-11 14:09:36,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/d74ee0c58fb149f3b353efcf48940aea to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/d74ee0c58fb149f3b353efcf48940aea 2023-07-11 14:09:36,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/012701dbd6bd463fb1431043cbeaa8c5_SeqId_47_ 2023-07-11 14:09:37,203 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309ad6c252732f4c9c9fcf56542049c7ea to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511309ad6c252732f4c9c9fcf56542049c7ea 2023-07-11 14:09:37,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:37,231 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05a0e7be3c6f47e8945c1d154bbe719f first=Optional[r00] last=Optional[r8] 2023-07-11 14:09:37,232 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05a0e7be3c6f47e8945c1d154bbe719f}] 2023-07-11 14:09:37,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05a0e7be3c6f47e8945c1d154bbe719f for inclusion in 46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:37,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-07-11 14:09:37,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:37,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:09:37,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/05a0e7be3c6f47e8945c1d154bbe719f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dt2v1m3jqhrl9akvjqp9prd544o13v1kt0orc8lihfrm5tg6vfpjoqigug4795c5/family1/05a0e7be3c6f47e8945c1d154bbe719f 2023-07-11 14:09:37,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dt2v1m3jqhrl9akvjqp9prd544o13v1kt0orc8lihfrm5tg6vfpjoqigug4795c5/family1/05a0e7be3c6f47e8945c1d154bbe719f as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/aa5d0a1e8db0418c961f01fc14e56a41_SeqId_50_ 2023-07-11 14:09:37,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dt2v1m3jqhrl9akvjqp9prd544o13v1kt0orc8lihfrm5tg6vfpjoqigug4795c5/family1/05a0e7be3c6f47e8945c1d154bbe719f into 46718097f9c05e645861136a4a7a8050/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/aa5d0a1e8db0418c961f01fc14e56a41_SeqId_50_ - updating store file list. 2023-07-11 14:09:37,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/aa5d0a1e8db0418c961f01fc14e56a41_SeqId_50_ into 46718097f9c05e645861136a4a7a8050/family1 2023-07-11 14:09:37,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dt2v1m3jqhrl9akvjqp9prd544o13v1kt0orc8lihfrm5tg6vfpjoqigug4795c5/family1/05a0e7be3c6f47e8945c1d154bbe719f into 46718097f9c05e645861136a4a7a8050/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/family1/aa5d0a1e8db0418c961f01fc14e56a41_SeqId_50_) 2023-07-11 14:09:37,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dt2v1m3jqhrl9akvjqp9prd544o13v1kt0orc8lihfrm5tg6vfpjoqigug4795c5/family1/05a0e7be3c6f47e8945c1d154bbe719f 2023-07-11 14:09:37,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:37,250 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:37,252 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200c1a11adc188421681ba90d2dab201b8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200c1a11adc188421681ba90d2dab201b8 2023-07-11 14:09:37,253 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128092f5c1ca3864288b21cee3e7d02e470 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128092f5c1ca3864288b21cee3e7d02e470 2023-07-11 14:09:37,255 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511301f157ed7cb1744558390527a467bc39d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511301f157ed7cb1744558390527a467bc39d 2023-07-11 14:09:37,255 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-07-11 14:09:37,255 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 14:09:37,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:37,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:37,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:09:37,255 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:09:37,256 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:37,257 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:37,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8310 sec 2023-07-11 14:09:37,414 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=257 (was 254) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37426 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37514 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5263849a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5181d2ba-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5263849a-shared-pool-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:51064 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5181d2ba-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50758 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5181d2ba-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37528 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37400 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37480 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50902 [Waiting for operation #39] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5181d2ba-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5263849a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37556 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37594 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:50952 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-513130931_17 at /127.0.0.1:50940 [Waiting for operation #32] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5263849a-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x3e07f602-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37564 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5181d2ba-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-513130931_17 at /127.0.0.1:37544 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x3e07f602-SendThread(127.0.0.1:63702) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37448 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37498 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5181d2ba-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_156406830_17 at /127.0.0.1:37490 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5181d2ba-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63702@0x3e07f602 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1887029990.run(Unknown Source) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=609 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=694 (was 700), ProcessCount=175 (was 175), AvailableMemoryMB=1381 (was 1535) 2023-07-11 14:09:37,445 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=694, ProcessCount=175, AvailableMemoryMB=1381 2023-07-11 14:09:37,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 14:09:37,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:37,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:09:37,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-07-11 14:09:37,460 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:09:37,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 14:09:37,463 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:37,464 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf empty. 2023-07-11 14:09:37,465 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:37,465 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-07-11 14:09:37,484 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:37,489 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => a0fbb332649998fdb41b01ab9fc81edf, NAME => 'testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:37,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 14:09:37,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 14:09:37,899 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:37,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing a0fbb332649998fdb41b01ab9fc81edf, disabling compactions & flushes 2023-07-11 14:09:37,900 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:37,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:37,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. after waiting 0 ms 2023-07-11 14:09:37,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:37,900 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:37,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:37,903 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:09:37,904 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689084577904"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084577904"}]},"ts":"1689084577904"} 2023-07-11 14:09:37,906 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:09:37,907 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:09:37,907 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084577907"}]},"ts":"1689084577907"} 2023-07-11 14:09:37,909 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-07-11 14:09:37,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a0fbb332649998fdb41b01ab9fc81edf, ASSIGN}] 2023-07-11 14:09:37,925 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a0fbb332649998fdb41b01ab9fc81edf, ASSIGN 2023-07-11 14:09:37,926 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a0fbb332649998fdb41b01ab9fc81edf, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:38,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 14:09:38,077 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a0fbb332649998fdb41b01ab9fc81edf, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:38,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689084578077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084578077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084578077"}]},"ts":"1689084578077"} 2023-07-11 14:09:38,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure a0fbb332649998fdb41b01ab9fc81edf, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:38,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:38,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0fbb332649998fdb41b01ab9fc81edf, NAME => 'testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:38,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:38,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:38,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:38,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:38,240 INFO [StoreOpener-a0fbb332649998fdb41b01ab9fc81edf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:38,241 DEBUG [StoreOpener-a0fbb332649998fdb41b01ab9fc81edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1 2023-07-11 14:09:38,242 DEBUG [StoreOpener-a0fbb332649998fdb41b01ab9fc81edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1 2023-07-11 14:09:38,242 INFO [StoreOpener-a0fbb332649998fdb41b01ab9fc81edf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0fbb332649998fdb41b01ab9fc81edf columnFamilyName family1 2023-07-11 14:09:38,244 INFO [StoreOpener-a0fbb332649998fdb41b01ab9fc81edf-1] regionserver.HStore(310): Store=a0fbb332649998fdb41b01ab9fc81edf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:38,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:38,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:38,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:09:38,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:38,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a0fbb332649998fdb41b01ab9fc81edf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65921115, jitterRate=-0.01769883930683136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:09:38,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:38,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf., pid=25, masterSystemTime=1689084578233 2023-07-11 14:09:38,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:38,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:38,259 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a0fbb332649998fdb41b01ab9fc81edf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:38,260 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689084578259"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084578259"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084578259"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084578259"}]},"ts":"1689084578259"} 2023-07-11 14:09:38,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-07-11 14:09:38,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure a0fbb332649998fdb41b01ab9fc81edf, server=jenkins-hbase9.apache.org,46743,1689084553537 in 181 msec 2023-07-11 14:09:38,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-11 14:09:38,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a0fbb332649998fdb41b01ab9fc81edf, ASSIGN in 342 msec 2023-07-11 14:09:38,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:09:38,267 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084578267"}]},"ts":"1689084578267"} 2023-07-11 14:09:38,269 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-07-11 14:09:38,273 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:09:38,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 819 msec 2023-07-11 14:09:38,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 14:09:38,567 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-07-11 14:09:38,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:38,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,602 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:38,603 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:38,603 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:38,603 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:38,603 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,603 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,605 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:38,605 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:38,605 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:38,605 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:38,607 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:38,607 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:38,607 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:38,609 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:38,609 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:38,609 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:38,610 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:38,610 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 14:09:39,049 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cfc65946e4d64fb3a6a330a9c5ca2c05 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130cfc65946e4d64fb3a6a330a9c5ca2c05 2023-07-11 14:09:39,454 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/c2f3ab07e5504bae946c65d9dfed59a7 2023-07-11 14:09:39,459 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/c2f3ab07e5504bae946c65d9dfed59a7 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c2f3ab07e5504bae946c65d9dfed59a7 2023-07-11 14:09:39,464 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c2f3ab07e5504bae946c65d9dfed59a7, entries=1000, sequenceid=5, filesize=165.1 K 2023-07-11 14:09:39,465 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 855ms, sequenceid=5, compaction requested=false 2023-07-11 14:09:39,465 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:39,465 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:39,465 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:39,465 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:39,466 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:39,466 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,466 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:39,466 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:39,467 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,467 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:39,468 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,468 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:39,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:39,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4baf987d[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:39,469 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:39,469 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,470 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,471 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:39,471 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:39,471 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:39,471 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,471 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:39,472 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:39,472 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,472 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:39,472 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:39,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:39,475 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:39,475 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:39,475 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:39,475 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,475 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:39,478 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,478 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,478 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:39,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:39,478 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,479 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,481 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,481 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,481 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,481 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,482 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:39,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:39,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:39,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:39,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:39,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:39,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:39,482 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:39,482 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:39,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:39,582 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:39,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:39,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:39,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:39,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,591 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:39,591 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:39,591 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:39,591 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:39,592 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,592 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,593 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:39,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:39,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,595 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,596 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,596 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,596 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:39,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:39,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,598 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:39,598 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:39,598 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:39,601 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:39,601 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:39,601 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:39,601 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:39,601 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 14:09:39,619 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cc721a74e1624053a13b9bd00428a6be to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128cc721a74e1624053a13b9bd00428a6be 2023-07-11 14:09:39,625 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/d17dfba2b5f542ee9d3ec232c7ea430b 2023-07-11 14:09:39,631 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/d17dfba2b5f542ee9d3ec232c7ea430b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/d17dfba2b5f542ee9d3ec232c7ea430b 2023-07-11 14:09:39,635 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/d17dfba2b5f542ee9d3ec232c7ea430b, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 14:09:39,636 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 35ms, sequenceid=9, compaction requested=false 2023-07-11 14:09:39,637 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:39,637 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:39,637 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:39,637 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:39,637 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,637 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:39,637 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:39,639 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,639 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:39,639 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,639 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:39,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:39,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:39,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:39,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d7265d6[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:39,641 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:39,641 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,642 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,643 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:39,643 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,643 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:39,643 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:39,643 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:39,644 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,644 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:39,644 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:39,645 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:39,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:39,647 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:39,647 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:39,647 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:39,647 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,647 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:39,649 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,649 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,649 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:39,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:39,650 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,651 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,653 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,653 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:39,653 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:39,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:39,653 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:39,653 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:39,653 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:39,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:39,653 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,654 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:39,654 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:39,654 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:39,654 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:39,654 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,754 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:39,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:39,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:39,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:39,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,762 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:39,762 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:39,762 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:39,762 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:39,762 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,762 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,764 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,764 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:39,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:39,765 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:39,765 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:39,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:39,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:39,766 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:39,766 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:39,766 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:39,766 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:39,766 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:39,766 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:39,766 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:39,766 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:40,181 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014657428fb3e64984a54624861af4e41f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014657428fb3e64984a54624861af4e41f 2023-07-11 14:09:40,588 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/4a95cdc0777244f787f287591356301c 2023-07-11 14:09:40,594 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/4a95cdc0777244f787f287591356301c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a95cdc0777244f787f287591356301c 2023-07-11 14:09:40,599 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a95cdc0777244f787f287591356301c, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 14:09:40,601 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 835ms, sequenceid=13, compaction requested=true 2023-07-11 14:09:40,601 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:40,601 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:40,601 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:40,601 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:40,601 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,601 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:40,601 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:40,603 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,603 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:40,604 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,604 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:40,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:40,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:40,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51bf3c0f[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:40,606 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:40,606 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,607 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,607 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:40,607 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:40,607 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:40,607 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,607 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:40,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:40,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:40,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:40,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:40,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:40,611 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:40,612 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:40,612 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:40,612 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,612 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:40,613 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,613 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,613 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:40,614 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,615 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,622 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,622 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:40,622 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:40,622 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:40,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:40,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:40,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:40,622 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:40,622 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,623 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,623 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:40,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:40,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:40,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:40,623 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,623 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:40,623 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,623 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,723 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:40,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:40,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:40,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:40,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,731 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:40,731 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:40,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:40,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:40,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,732 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,733 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,733 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:40,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:40,734 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:40,734 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,735 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:40,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:40,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:40,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:40,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:40,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:40,735 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:40,735 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:40,735 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:40,736 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:41,155 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b6b71688276547e4ac124bef7caab8ba to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205b6b71688276547e4ac124bef7caab8ba 2023-07-11 14:09:41,561 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/37b067f3a9c3482ca116a09684eb43c5 2023-07-11 14:09:41,567 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/37b067f3a9c3482ca116a09684eb43c5 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/37b067f3a9c3482ca116a09684eb43c5 2023-07-11 14:09:41,572 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/37b067f3a9c3482ca116a09684eb43c5, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 14:09:41,573 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 837ms, sequenceid=17, compaction requested=true 2023-07-11 14:09:41,573 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:41,573 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:41,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:41,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:41,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:41,573 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:41,599 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,599 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:41,599 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,599 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:41,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:41,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d975fb3[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:41,601 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:41,601 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,622 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,622 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:41,622 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:41,622 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:41,622 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,622 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:41,660 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:41,660 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,660 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:41,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,660 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:41,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:41,663 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:41,663 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:41,663 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:41,663 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,663 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:41,683 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,683 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,683 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:41,684 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,685 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,714 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,714 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:41,714 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:41,714 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:41,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:41,714 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:41,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:41,714 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:41,714 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:41,715 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,715 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:41,715 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:41,715 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:41,715 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:41,815 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:41,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:41,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:41,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:41,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,823 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:41,823 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:41,823 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:41,823 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:41,823 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,824 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,837 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:41,837 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:41,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:41,838 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:41,838 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:41,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:41,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,839 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:41,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:41,839 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:41,839 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:41,839 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:41,839 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:41,839 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:41,839 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:41,839 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:41,839 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:41,857 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280e6116bcd4ab4ec58019f25e72442b82 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512280e6116bcd4ab4ec58019f25e72442b82 2023-07-11 14:09:42,263 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/54f31407f94f439f8f593e576640f340 2023-07-11 14:09:42,271 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/54f31407f94f439f8f593e576640f340 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/54f31407f94f439f8f593e576640f340 2023-07-11 14:09:42,277 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/54f31407f94f439f8f593e576640f340, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 14:09:42,279 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 439ms, sequenceid=21, compaction requested=true 2023-07-11 14:09:42,279 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:42,279 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:42,279 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:42,279 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:42,279 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,279 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:42,279 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:42,293 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:42,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:42,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:42,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a4c5e0c[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:42,298 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:42,298 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,307 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,307 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:42,308 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:42,308 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:42,308 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,308 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:42,330 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:42,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,330 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:42,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:42,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:42,330 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:42,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:42,333 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:42,333 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:42,333 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:42,333 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,333 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:42,353 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,353 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:42,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,353 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:42,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:42,354 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,355 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,376 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:42,376 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:42,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:42,376 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:42,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:42,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:42,376 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:42,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:42,376 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,377 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,377 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:42,377 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,377 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:42,377 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:42,377 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:42,477 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:42,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:42,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:42,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,486 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:42,486 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:42,486 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:42,486 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:42,487 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,487 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,488 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:42,488 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:42,489 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,489 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,490 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,490 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:42,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,490 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:42,490 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:42,490 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:42,490 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:42,491 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:42,491 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:42,491 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:42,491 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:42,910 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313ba87511c982413c89ddc0461b5e56e3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512313ba87511c982413c89ddc0461b5e56e3 2023-07-11 14:09:42,916 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/b99b7d61aedc44e2a40efe582f4ad96a 2023-07-11 14:09:42,921 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/b99b7d61aedc44e2a40efe582f4ad96a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/b99b7d61aedc44e2a40efe582f4ad96a 2023-07-11 14:09:42,926 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/b99b7d61aedc44e2a40efe582f4ad96a, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 14:09:42,928 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 436ms, sequenceid=25, compaction requested=true 2023-07-11 14:09:42,928 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:42,928 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:42,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:42,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:42,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:42,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:42,930 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,930 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:42,930 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,930 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:42,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:42,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cedc46[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:42,932 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:42,932 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,933 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,933 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:42,933 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:42,933 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:42,933 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,933 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:42,942 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:42,942 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:42,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,942 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:42,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:42,945 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:42,946 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:42,946 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:42,946 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,946 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:42,947 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,947 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,947 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:42,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:42,948 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,949 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:42,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:42,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:42,951 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:42,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:42,951 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:42,952 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:42,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:42,952 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:42,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:43,052 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:43,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:43,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:43,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:43,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,060 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:43,060 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:43,060 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:43,060 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:43,060 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,060 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,061 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:43,061 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:43,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:43,062 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,062 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:43,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:43,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:43,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:43,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:43,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:43,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:43,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:43,063 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:43,063 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:43,063 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:43,477 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d322757f006b4a92acff1f3d22d8ba29 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d322757f006b4a92acff1f3d22d8ba29 2023-07-11 14:09:43,740 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:09:43,883 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/c1c6d137b16345dfa74be618f0676769 2023-07-11 14:09:43,889 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/c1c6d137b16345dfa74be618f0676769 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c1c6d137b16345dfa74be618f0676769 2023-07-11 14:09:43,894 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c1c6d137b16345dfa74be618f0676769, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 14:09:43,895 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 832ms, sequenceid=29, compaction requested=true 2023-07-11 14:09:43,895 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:43,895 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:43,895 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:43,895 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:43,895 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,895 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:43,895 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:43,898 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:43,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:43,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:43,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c39d794[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:43,900 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:43,900 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,901 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,902 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:43,902 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:43,902 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:43,902 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,902 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:43,904 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:43,904 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:43,904 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:43,904 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:43,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:43,907 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:43,907 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:43,907 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:43,907 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,907 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:43,910 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,910 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:43,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:43,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,910 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:43,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:43,912 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:43,913 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:43,917 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,917 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:43,918 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:43,918 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:43,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:43,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:44,018 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:44,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:44,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:44,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:44,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,030 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:44,030 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:44,030 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:44,030 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:44,031 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,031 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,032 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,032 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:44,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:44,033 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,033 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:44,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,034 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,034 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:44,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,034 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:44,034 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:44,034 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:44,035 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:44,035 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:44,035 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:44,035 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:44,035 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:44,053 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033457753393af49a397c2e0a284f4f78c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601033457753393af49a397c2e0a284f4f78c 2023-07-11 14:09:44,058 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/a41dfc6a4003418f9ca41d6f12e32bf2 2023-07-11 14:09:44,064 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/a41dfc6a4003418f9ca41d6f12e32bf2 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/a41dfc6a4003418f9ca41d6f12e32bf2 2023-07-11 14:09:44,069 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/a41dfc6a4003418f9ca41d6f12e32bf2, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 14:09:44,070 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 35ms, sequenceid=33, compaction requested=true 2023-07-11 14:09:44,071 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:44,071 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:44,071 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:44,071 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:44,071 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,071 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:44,071 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:44,073 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,073 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:44,074 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,074 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:44,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:44,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b047f67[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:44,075 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:44,075 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,083 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,083 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:44,083 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:44,083 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:44,083 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,083 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:44,085 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:44,085 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,085 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,085 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:44,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:44,087 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:44,088 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:44,088 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:44,088 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,088 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:44,089 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,089 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:44,089 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,090 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:44,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,091 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,093 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,093 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:44,094 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:44,094 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:44,094 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,094 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,094 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,094 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,094 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:44,094 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:44,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:44,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:44,095 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:44,095 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:44,195 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:44,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:44,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:44,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:44,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,203 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:44,203 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:44,203 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:44,203 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:44,204 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,204 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,206 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,206 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:44,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:44,206 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,206 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,207 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,208 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:44,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,208 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:44,208 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:44,208 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:44,208 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:44,208 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:44,208 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:44,208 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:44,208 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:44,625 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074e5c3fa95d1249db9ea2e800d1c54e29 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509074e5c3fa95d1249db9ea2e800d1c54e29 2023-07-11 14:09:44,631 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/02314c776ba04485a0fedd6f92b9a699 2023-07-11 14:09:44,640 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/02314c776ba04485a0fedd6f92b9a699 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/02314c776ba04485a0fedd6f92b9a699 2023-07-11 14:09:44,647 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/02314c776ba04485a0fedd6f92b9a699, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 14:09:44,648 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 440ms, sequenceid=37, compaction requested=true 2023-07-11 14:09:44,648 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:44,648 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:44,648 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:44,648 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:44,648 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,648 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:44,648 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:44,650 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,650 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:44,651 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,651 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:44,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:44,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:44,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:44,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:44,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4380f235[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:44,652 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:44,653 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,660 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,660 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:44,660 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:44,660 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:44,660 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,660 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:44,661 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:44,661 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,661 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:44,661 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:44,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:44,664 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:44,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:44,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:44,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,664 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:44,666 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,666 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,666 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:44,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:44,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,667 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:44,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,669 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,669 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:44,669 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:44,670 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:44,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:44,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:44,670 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:44,771 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:44,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:44,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:44,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:44,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,778 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:44,778 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:44,778 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:44,778 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:44,779 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,779 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,783 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:44,783 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:44,783 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:44,783 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:44,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,784 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,784 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:44,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:44,785 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:44,785 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:44,785 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:44,785 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:44,785 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:44,785 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:44,785 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. started... 2023-07-11 14:09:44,785 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a0fbb332649998fdb41b01ab9fc81edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:44,808 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511209ceef75e5f5f492598d165c51ffa62e2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511209ceef75e5f5f492598d165c51ffa62e2 2023-07-11 14:09:45,215 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/06b052a127eb41579d894fb65c89616e 2023-07-11 14:09:45,222 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/06b052a127eb41579d894fb65c89616e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/06b052a127eb41579d894fb65c89616e 2023-07-11 14:09:45,228 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/06b052a127eb41579d894fb65c89616e, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 14:09:45,229 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a0fbb332649998fdb41b01ab9fc81edf in 444ms, sequenceid=41, compaction requested=true 2023-07-11 14:09:45,229 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:45,229 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:45,229 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:45,229 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:45,229 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,229 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:45,229 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:45,231 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,231 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:45,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:45,231 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,231 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:45,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:45,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:45,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:45,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:45,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@315e3aef[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:45,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:45,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,234 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,234 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:45,234 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:45,234 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:45,234 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,234 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:45,236 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,236 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:45,236 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:45,236 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:45,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:45,239 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:45,239 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:45,239 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:45,239 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,239 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:45,241 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,241 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,241 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:45,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,241 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:45,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,243 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:45,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:45,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:45,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 14:09:45,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:45,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:45,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:45,246 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:45,246 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:45,245 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:45,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:45,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:45,246 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,246 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:45,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:45,246 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,346 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:45,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:45,349 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-07-11 14:09:45,350 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:45,352 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:45,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:45,353 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085185352 2023-07-11 14:09:45,353 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 14:09:45,355 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-07-11 14:09:45,355 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:45,355 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x5d68e56d to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:45,359 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37101bae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:45,359 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,410 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034bd24009382f470baa1592bc8ab41522 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034bd24009382f470baa1592bc8ab41522 2023-07-11 14:09:45,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:45,424 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:45,426 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:45,433 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:09:45,435 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:09:45,446 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7cf0b12b13804b5e84af0bb00d420855 first=Optional[r3] last=Optional[r6] 2023-07-11 14:09:45,447 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7cf0b12b13804b5e84af0bb00d420855}] 2023-07-11 14:09:45,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7cf0b12b13804b5e84af0bb00d420855 for inclusion in a0fbb332649998fdb41b01ab9fc81edf/family1 2023-07-11 14:09:45,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 14:09:45,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:45,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:45,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7cf0b12b13804b5e84af0bb00d420855 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__mpqes6lj120efmvlkfr1tfkn8lpdnt5klvfcqfdc3pdfknuaeinagr11i0gsg19b/family1/7cf0b12b13804b5e84af0bb00d420855 2023-07-11 14:09:45,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__mpqes6lj120efmvlkfr1tfkn8lpdnt5klvfcqfdc3pdfknuaeinagr11i0gsg19b/family1/7cf0b12b13804b5e84af0bb00d420855 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_ 2023-07-11 14:09:45,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__mpqes6lj120efmvlkfr1tfkn8lpdnt5klvfcqfdc3pdfknuaeinagr11i0gsg19b/family1/7cf0b12b13804b5e84af0bb00d420855 into a0fbb332649998fdb41b01ab9fc81edf/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_ - updating store file list. 2023-07-11 14:09:45,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_ into a0fbb332649998fdb41b01ab9fc81edf/family1 2023-07-11 14:09:45,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__mpqes6lj120efmvlkfr1tfkn8lpdnt5klvfcqfdc3pdfknuaeinagr11i0gsg19b/family1/7cf0b12b13804b5e84af0bb00d420855 into a0fbb332649998fdb41b01ab9fc81edf/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_) 2023-07-11 14:09:45,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__mpqes6lj120efmvlkfr1tfkn8lpdnt5klvfcqfdc3pdfknuaeinagr11i0gsg19b/family1/7cf0b12b13804b5e84af0bb00d420855 2023-07-11 14:09:45,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 14:09:45,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 14:09:45,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): a0fbb332649998fdb41b01ab9fc81edf/family1 is initiating minor compaction 2023-07-11 14:09:45,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7cd75012; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:45,469 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a0fbb332649998fdb41b01ab9fc81edf/family1 in testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:45,469 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/d17dfba2b5f542ee9d3ec232c7ea430b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a95cdc0777244f787f287591356301c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/37b067f3a9c3482ca116a09684eb43c5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/54f31407f94f439f8f593e576640f340, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/b99b7d61aedc44e2a40efe582f4ad96a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c1c6d137b16345dfa74be618f0676769, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/a41dfc6a4003418f9ca41d6f12e32bf2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/02314c776ba04485a0fedd6f92b9a699, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/06b052a127eb41579d894fb65c89616e, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp, totalSize=50.0 K 2023-07-11 14:09:45,469 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting d17dfba2b5f542ee9d3ec232c7ea430b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:09:45,469 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 4a95cdc0777244f787f287591356301c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:09:45,469 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 37b067f3a9c3482ca116a09684eb43c5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 14:09:45,469 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 54f31407f94f439f8f593e576640f340, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 14:09:45,469 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting b99b7d61aedc44e2a40efe582f4ad96a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 14:09:45,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting c1c6d137b16345dfa74be618f0676769, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 14:09:45,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting a41dfc6a4003418f9ca41d6f12e32bf2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 14:09:45,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 02314c776ba04485a0fedd6f92b9a699, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 14:09:45,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 06b052a127eb41579d894fb65c89616e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 14:09:45,470 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 14:09:45,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:45,472 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:45,474 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512280e6116bcd4ab4ec58019f25e72442b82 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512280e6116bcd4ab4ec58019f25e72442b82 2023-07-11 14:09:45,475 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512313ba87511c982413c89ddc0461b5e56e3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512313ba87511c982413c89ddc0461b5e56e3 2023-07-11 14:09:45,477 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d322757f006b4a92acff1f3d22d8ba29 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d322757f006b4a92acff1f3d22d8ba29 2023-07-11 14:09:45,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601033457753393af49a397c2e0a284f4f78c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601033457753393af49a397c2e0a284f4f78c 2023-07-11 14:09:45,478 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-07-11 14:09:45,478 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,526 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): a0fbb332649998fdb41b01ab9fc81edf#family1#compaction#34 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:45,568 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f5a3bc51eb3d4d118bd5129e2f9d8bb0 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5a3bc51eb3d4d118bd5129e2f9d8bb0 2023-07-11 14:09:45,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:45,578 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/ad0e8267d5a645a99f9b4009caea6467 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/ad0e8267d5a645a99f9b4009caea6467 2023-07-11 14:09:45,587 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a0fbb332649998fdb41b01ab9fc81edf/family1 of a0fbb332649998fdb41b01ab9fc81edf into ad0e8267d5a645a99f9b4009caea6467(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:45,587 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:45,587 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1689084585468; duration=0sec 2023-07-11 14:09:45,587 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:45,614 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa3f95db57704919ab46a753e809a2c5 first=Optional[r1] last=Optional[r2] 2023-07-11 14:09:45,614 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa3f95db57704919ab46a753e809a2c5}] 2023-07-11 14:09:45,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa3f95db57704919ab46a753e809a2c5 for inclusion in a0fbb332649998fdb41b01ab9fc81edf/family1 2023-07-11 14:09:45,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-07-11 14:09:45,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:45,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:45,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa3f95db57704919ab46a753e809a2c5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__54vmgu97177a1m5tpj7j9m5c7ee7nv754mibi81u5vhibqco3j1fr4r9g30pnb1o/family1/fa3f95db57704919ab46a753e809a2c5 2023-07-11 14:09:45,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__54vmgu97177a1m5tpj7j9m5c7ee7nv754mibi81u5vhibqco3j1fr4r9g30pnb1o/family1/fa3f95db57704919ab46a753e809a2c5 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_ 2023-07-11 14:09:45,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__54vmgu97177a1m5tpj7j9m5c7ee7nv754mibi81u5vhibqco3j1fr4r9g30pnb1o/family1/fa3f95db57704919ab46a753e809a2c5 into a0fbb332649998fdb41b01ab9fc81edf/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_ - updating store file list. 2023-07-11 14:09:45,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_ into a0fbb332649998fdb41b01ab9fc81edf/family1 2023-07-11 14:09:45,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__54vmgu97177a1m5tpj7j9m5c7ee7nv754mibi81u5vhibqco3j1fr4r9g30pnb1o/family1/fa3f95db57704919ab46a753e809a2c5 into a0fbb332649998fdb41b01ab9fc81edf/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_) 2023-07-11 14:09:45,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__54vmgu97177a1m5tpj7j9m5c7ee7nv754mibi81u5vhibqco3j1fr4r9g30pnb1o/family1/fa3f95db57704919ab46a753e809a2c5 2023-07-11 14:09:45,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 14:09:45,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 14:09:45,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): a0fbb332649998fdb41b01ab9fc81edf/family1 is initiating minor compaction (all files) 2023-07-11 14:09:45,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@578de972; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:45,634 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a0fbb332649998fdb41b01ab9fc81edf/family1 in testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:09:45,634 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c2f3ab07e5504bae946c65d9dfed59a7, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/ad0e8267d5a645a99f9b4009caea6467, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp, totalSize=176.8 K 2023-07-11 14:09:45,634 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting c2f3ab07e5504bae946c65d9dfed59a7, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878818110 2023-07-11 14:09:45,635 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting ad0e8267d5a645a99f9b4009caea6467, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621218110 2023-07-11 14:09:45,636 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 98a3707ea6864bf88901d53fe53e533d_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965218110 2023-07-11 14:09:45,636 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:45,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:45,639 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014657428fb3e64984a54624861af4e41f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014657428fb3e64984a54624861af4e41f 2023-07-11 14:09:45,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205b6b71688276547e4ac124bef7caab8ba to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205b6b71688276547e4ac124bef7caab8ba 2023-07-11 14:09:45,640 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-07-11 14:09:45,640 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 14:09:45,641 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:45,641 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:45,641 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:45,642 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:45,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 293 msec 2023-07-11 14:09:45,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/d17dfba2b5f542ee9d3ec232c7ea430b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a95cdc0777244f787f287591356301c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/37b067f3a9c3482ca116a09684eb43c5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/54f31407f94f439f8f593e576640f340, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/b99b7d61aedc44e2a40efe582f4ad96a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c1c6d137b16345dfa74be618f0676769, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/a41dfc6a4003418f9ca41d6f12e32bf2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/02314c776ba04485a0fedd6f92b9a699, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/06b052a127eb41579d894fb65c89616e, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_] to archive 2023-07-11 14:09:45,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:45,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/d17dfba2b5f542ee9d3ec232c7ea430b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/d17dfba2b5f542ee9d3ec232c7ea430b 2023-07-11 14:09:45,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a95cdc0777244f787f287591356301c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a95cdc0777244f787f287591356301c 2023-07-11 14:09:45,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/37b067f3a9c3482ca116a09684eb43c5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/37b067f3a9c3482ca116a09684eb43c5 2023-07-11 14:09:45,670 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): a0fbb332649998fdb41b01ab9fc81edf#family1#compaction#35 average throughput is 11.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:45,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/54f31407f94f439f8f593e576640f340 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/54f31407f94f439f8f593e576640f340 2023-07-11 14:09:45,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/b99b7d61aedc44e2a40efe582f4ad96a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/b99b7d61aedc44e2a40efe582f4ad96a 2023-07-11 14:09:45,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c1c6d137b16345dfa74be618f0676769 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c1c6d137b16345dfa74be618f0676769 2023-07-11 14:09:45,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/a41dfc6a4003418f9ca41d6f12e32bf2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/a41dfc6a4003418f9ca41d6f12e32bf2 2023-07-11 14:09:45,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/02314c776ba04485a0fedd6f92b9a699 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/02314c776ba04485a0fedd6f92b9a699 2023-07-11 14:09:45,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/06b052a127eb41579d894fb65c89616e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/06b052a127eb41579d894fb65c89616e 2023-07-11 14:09:45,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/4a5346c84e7f431eb598e9aca2e08d3a_SeqId_44_ 2023-07-11 14:09:45,709 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-07-11 14:09:45,757 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/.tmp/family1/5d25ca2699274b3b846d3138bca604f4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/5d25ca2699274b3b846d3138bca604f4 2023-07-11 14:09:45,766 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a0fbb332649998fdb41b01ab9fc81edf/family1 of a0fbb332649998fdb41b01ab9fc81edf into 5d25ca2699274b3b846d3138bca604f4(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:45,766 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:09:45,767 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1689084585633; duration=0sec 2023-07-11 14:09:45,767 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:45,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c2f3ab07e5504bae946c65d9dfed59a7, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/ad0e8267d5a645a99f9b4009caea6467, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_] to archive 2023-07-11 14:09:45,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:45,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c2f3ab07e5504bae946c65d9dfed59a7 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/c2f3ab07e5504bae946c65d9dfed59a7 2023-07-11 14:09:45,851 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=262 (was 257) - Thread LEAK? -, OpenFileDescriptor=625 (was 611) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=649 (was 694), ProcessCount=177 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=1311 (was 1381) 2023-07-11 14:09:45,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/ad0e8267d5a645a99f9b4009caea6467 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/ad0e8267d5a645a99f9b4009caea6467 2023-07-11 14:09:45,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/family1/98a3707ea6864bf88901d53fe53e533d_SeqId_47_ 2023-07-11 14:09:45,893 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=262, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=649, ProcessCount=177, AvailableMemoryMB=1311 2023-07-11 14:09:45,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 14:09:45,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:45,906 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:09:45,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-07-11 14:09:45,907 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:09:45,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 14:09:45,925 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:45,934 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83 empty. 2023-07-11 14:09:45,934 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:45,944 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:45,945 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7 empty. 2023-07-11 14:09:45,945 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f 2023-07-11 14:09:45,947 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f empty. 2023-07-11 14:09:45,949 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f 2023-07-11 14:09:45,953 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:45,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-07-11 14:09:45,997 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:45,999 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1a59eba5ceb1b37937c91647cca969e7, NAME => 'testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:45,999 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 80765973aeda01239012c20bac5b9d83, NAME => 'testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:45,999 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => cddba20831049118a1940b3fa858141f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:46,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 14:09:46,023 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:46,023 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing cddba20831049118a1940b3fa858141f, disabling compactions & flushes 2023-07-11 14:09:46,023 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:46,023 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:46,023 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. after waiting 0 ms 2023-07-11 14:09:46,023 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:46,023 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:46,023 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for cddba20831049118a1940b3fa858141f: 2023-07-11 14:09:46,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 14:09:46,417 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:46,417 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 1a59eba5ceb1b37937c91647cca969e7, disabling compactions & flushes 2023-07-11 14:09:46,417 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:46,417 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:46,417 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. after waiting 0 ms 2023-07-11 14:09:46,417 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:46,417 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:46,417 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 1a59eba5ceb1b37937c91647cca969e7: 2023-07-11 14:09:46,418 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:46,418 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 80765973aeda01239012c20bac5b9d83, disabling compactions & flushes 2023-07-11 14:09:46,418 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:46,418 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:46,418 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. after waiting 0 ms 2023-07-11 14:09:46,418 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:46,418 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:46,418 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 80765973aeda01239012c20bac5b9d83: 2023-07-11 14:09:46,421 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:09:46,422 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689084586422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084586422"}]},"ts":"1689084586422"} 2023-07-11 14:09:46,423 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689084586422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084586422"}]},"ts":"1689084586422"} 2023-07-11 14:09:46,423 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689084586422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084586422"}]},"ts":"1689084586422"} 2023-07-11 14:09:46,426 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 14:09:46,427 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:09:46,427 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084586427"}]},"ts":"1689084586427"} 2023-07-11 14:09:46,429 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-07-11 14:09:46,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=80765973aeda01239012c20bac5b9d83, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cddba20831049118a1940b3fa858141f, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1a59eba5ceb1b37937c91647cca969e7, ASSIGN}] 2023-07-11 14:09:46,436 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1a59eba5ceb1b37937c91647cca969e7, ASSIGN 2023-07-11 14:09:46,436 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cddba20831049118a1940b3fa858141f, ASSIGN 2023-07-11 14:09:46,437 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=80765973aeda01239012c20bac5b9d83, ASSIGN 2023-07-11 14:09:46,438 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cddba20831049118a1940b3fa858141f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:46,439 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1a59eba5ceb1b37937c91647cca969e7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:46,440 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=80765973aeda01239012c20bac5b9d83, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 14:09:46,591 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1a59eba5ceb1b37937c91647cca969e7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:46,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=80765973aeda01239012c20bac5b9d83, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:46,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cddba20831049118a1940b3fa858141f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:46,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689084586591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084586591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084586591"}]},"ts":"1689084586591"} 2023-07-11 14:09:46,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689084586591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084586591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084586591"}]},"ts":"1689084586591"} 2023-07-11 14:09:46,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689084586591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084586591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084586591"}]},"ts":"1689084586591"} 2023-07-11 14:09:46,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 1a59eba5ceb1b37937c91647cca969e7, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:46,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 80765973aeda01239012c20bac5b9d83, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:46,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure cddba20831049118a1940b3fa858141f, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:46,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:46,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a59eba5ceb1b37937c91647cca969e7, NAME => 'testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 14:09:46,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,751 INFO [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,752 DEBUG [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1 2023-07-11 14:09:46,753 DEBUG [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1 2023-07-11 14:09:46,753 INFO [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a59eba5ceb1b37937c91647cca969e7 columnFamilyName family1 2023-07-11 14:09:46,755 INFO [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] regionserver.HStore(310): Store=1a59eba5ceb1b37937c91647cca969e7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:46,755 INFO [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,757 DEBUG [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family2 2023-07-11 14:09:46,757 DEBUG [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family2 2023-07-11 14:09:46,757 INFO [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a59eba5ceb1b37937c91647cca969e7 columnFamilyName family2 2023-07-11 14:09:46,759 INFO [StoreOpener-1a59eba5ceb1b37937c91647cca969e7-1] regionserver.HStore(310): Store=1a59eba5ceb1b37937c91647cca969e7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:46,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:09:46,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:09:46,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:46,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1a59eba5ceb1b37937c91647cca969e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59217968, jitterRate=-0.1175835132598877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:09:46,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1a59eba5ceb1b37937c91647cca969e7: 2023-07-11 14:09:46,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7., pid=31, masterSystemTime=1689084586745 2023-07-11 14:09:46,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:46,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:46,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:46,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cddba20831049118a1940b3fa858141f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 14:09:46,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1a59eba5ceb1b37937c91647cca969e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:46,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:46,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689084586770"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084586770"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084586770"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084586770"}]},"ts":"1689084586770"} 2023-07-11 14:09:46,772 INFO [StoreOpener-cddba20831049118a1940b3fa858141f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-07-11 14:09:46,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 1a59eba5ceb1b37937c91647cca969e7, server=jenkins-hbase9.apache.org,46743,1689084553537 in 179 msec 2023-07-11 14:09:46,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1a59eba5ceb1b37937c91647cca969e7, ASSIGN in 341 msec 2023-07-11 14:09:46,783 DEBUG [StoreOpener-cddba20831049118a1940b3fa858141f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f/family1 2023-07-11 14:09:46,783 DEBUG [StoreOpener-cddba20831049118a1940b3fa858141f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f/family1 2023-07-11 14:09:46,783 INFO [StoreOpener-cddba20831049118a1940b3fa858141f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cddba20831049118a1940b3fa858141f columnFamilyName family1 2023-07-11 14:09:46,784 INFO [StoreOpener-cddba20831049118a1940b3fa858141f-1] regionserver.HStore(310): Store=cddba20831049118a1940b3fa858141f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:46,785 INFO [StoreOpener-cddba20831049118a1940b3fa858141f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,786 DEBUG [StoreOpener-cddba20831049118a1940b3fa858141f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f/family2 2023-07-11 14:09:46,787 DEBUG [StoreOpener-cddba20831049118a1940b3fa858141f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f/family2 2023-07-11 14:09:46,787 INFO [StoreOpener-cddba20831049118a1940b3fa858141f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cddba20831049118a1940b3fa858141f columnFamilyName family2 2023-07-11 14:09:46,788 INFO [StoreOpener-cddba20831049118a1940b3fa858141f-1] regionserver.HStore(310): Store=cddba20831049118a1940b3fa858141f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:46,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:09:46,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for cddba20831049118a1940b3fa858141f 2023-07-11 14:09:46,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:46,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened cddba20831049118a1940b3fa858141f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73983054, jitterRate=0.10243341326713562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:09:46,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for cddba20831049118a1940b3fa858141f: 2023-07-11 14:09:46,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f., pid=33, masterSystemTime=1689084586745 2023-07-11 14:09:46,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:46,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:46,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:46,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80765973aeda01239012c20bac5b9d83, NAME => 'testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 14:09:46,798 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cddba20831049118a1940b3fa858141f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:46,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,798 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689084586797"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084586797"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084586797"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084586797"}]},"ts":"1689084586797"} 2023-07-11 14:09:46,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:46,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-07-11 14:09:46,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure cddba20831049118a1940b3fa858141f, server=jenkins-hbase9.apache.org,46743,1689084553537 in 204 msec 2023-07-11 14:09:46,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cddba20831049118a1940b3fa858141f, ASSIGN in 368 msec 2023-07-11 14:09:46,802 INFO [StoreOpener-80765973aeda01239012c20bac5b9d83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,804 DEBUG [StoreOpener-80765973aeda01239012c20bac5b9d83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83/family1 2023-07-11 14:09:46,804 DEBUG [StoreOpener-80765973aeda01239012c20bac5b9d83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83/family1 2023-07-11 14:09:46,804 INFO [StoreOpener-80765973aeda01239012c20bac5b9d83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80765973aeda01239012c20bac5b9d83 columnFamilyName family1 2023-07-11 14:09:46,805 INFO [StoreOpener-80765973aeda01239012c20bac5b9d83-1] regionserver.HStore(310): Store=80765973aeda01239012c20bac5b9d83/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:46,806 INFO [StoreOpener-80765973aeda01239012c20bac5b9d83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,807 DEBUG [StoreOpener-80765973aeda01239012c20bac5b9d83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83/family2 2023-07-11 14:09:46,807 DEBUG [StoreOpener-80765973aeda01239012c20bac5b9d83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83/family2 2023-07-11 14:09:46,807 INFO [StoreOpener-80765973aeda01239012c20bac5b9d83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80765973aeda01239012c20bac5b9d83 columnFamilyName family2 2023-07-11 14:09:46,808 INFO [StoreOpener-80765973aeda01239012c20bac5b9d83-1] regionserver.HStore(310): Store=80765973aeda01239012c20bac5b9d83/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:46,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:09:46,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 80765973aeda01239012c20bac5b9d83 2023-07-11 14:09:46,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:46,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 80765973aeda01239012c20bac5b9d83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64175419, jitterRate=-0.04371173679828644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:09:46,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 80765973aeda01239012c20bac5b9d83: 2023-07-11 14:09:46,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83., pid=32, masterSystemTime=1689084586745 2023-07-11 14:09:46,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:46,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:46,817 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=80765973aeda01239012c20bac5b9d83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:46,817 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689084586817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084586817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084586817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084586817"}]},"ts":"1689084586817"} 2023-07-11 14:09:46,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-07-11 14:09:46,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 80765973aeda01239012c20bac5b9d83, server=jenkins-hbase9.apache.org,46743,1689084553537 in 225 msec 2023-07-11 14:09:46,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-11 14:09:46,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=80765973aeda01239012c20bac5b9d83, ASSIGN in 387 msec 2023-07-11 14:09:46,823 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:09:46,823 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084586823"}]},"ts":"1689084586823"} 2023-07-11 14:09:46,825 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-07-11 14:09:46,827 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:09:46,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 931 msec 2023-07-11 14:09:47,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 14:09:47,014 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-07-11 14:09:47,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:47,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,024 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-07-11 14:09:47,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:47,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-07-11 14:09:47,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-07-11 14:09:47,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,025 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,026 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:47,026 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:47,026 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,026 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,028 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,032 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-07-11 14:09:47,032 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:47,032 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-07-11 14:09:47,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:47,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:47,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:47,033 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:09:47,033 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:47,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. started... 2023-07-11 14:09:47,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. started... 2023-07-11 14:09:47,033 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. started... 2023-07-11 14:09:47,035 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80765973aeda01239012c20bac5b9d83: 2023-07-11 14:09:47,035 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cddba20831049118a1940b3fa858141f: 2023-07-11 14:09:47,035 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:47,035 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1a59eba5ceb1b37937c91647cca969e7 2/2 column families, dataSize=48 B heapSize=632 B 2023-07-11 14:09:47,035 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:09:47,035 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:47,035 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:09:47,456 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307114185ae460e914309a6d6ca42dddd15cb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202307114185ae460e914309a6d6ca42dddd15cb 2023-07-11 14:09:47,863 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/.tmp/family1/313352a1f04b4a1395c743e98a49eda1 2023-07-11 14:09:47,868 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/.tmp/family1/313352a1f04b4a1395c743e98a49eda1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/313352a1f04b4a1395c743e98a49eda1 2023-07-11 14:09:47,873 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/313352a1f04b4a1395c743e98a49eda1, entries=1, sequenceid=5, filesize=4.9 K 2023-07-11 14:09:47,874 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 1a59eba5ceb1b37937c91647cca969e7 in 839ms, sequenceid=5, compaction requested=false 2023-07-11 14:09:47,874 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-07-11 14:09:47,874 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1a59eba5ceb1b37937c91647cca969e7: 2023-07-11 14:09:47,874 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:47,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:09:47,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:09:47,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-07-11 14:09:47,875 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-07-11 14:09:47,876 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,876 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:47,877 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:47,877 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:47,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-07-11 14:09:47,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5339de27[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:47,878 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-07-11 14:09:47,878 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,879 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,880 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-07-11 14:09:47,880 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-07-11 14:09:47,880 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,880 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:47,880 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:47,881 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-07-11 14:09:47,881 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,881 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:47,881 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-07-11 14:09:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:47,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-07-11 14:09:47,884 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-07-11 14:09:47,884 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:47,884 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:47,884 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,884 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:47,886 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,887 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:47,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,887 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:47,887 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,888 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,895 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:47,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-07-11 14:09:47,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:47,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:47,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-07-11 14:09:47,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:47,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:47,895 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:47,896 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:47,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:47,996 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:47,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:48,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:48,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:48,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,003 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-07-11 14:09:48,003 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:48,003 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-07-11 14:09:48,003 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-07-11 14:09:48,004 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,004 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,005 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,005 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:48,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:48,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:48,005 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,005 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:48,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,006 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-07-11 14:09:48,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,006 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-07-11 14:09:48,006 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:48,006 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:48,008 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. started... 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. started... 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:48,008 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1a59eba5ceb1b37937c91647cca969e7 2/2 column families, dataSize=90 B heapSize=752 B 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80765973aeda01239012c20bac5b9d83: 2023-07-11 14:09:48,008 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:09:48,008 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. started... 2023-07-11 14:09:48,009 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:09:48,009 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cddba20831049118a1940b3fa858141f: 2023-07-11 14:09:48,009 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:09:48,009 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:09:48,023 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711b8f9c3129838442ba9ef992fce29249a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711b8f9c3129838442ba9ef992fce29249a 2023-07-11 14:09:48,428 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/.tmp/family1/18636cea2bb745109bdaac603cacdc29 2023-07-11 14:09:48,434 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/.tmp/family1/18636cea2bb745109bdaac603cacdc29 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/18636cea2bb745109bdaac603cacdc29 2023-07-11 14:09:48,438 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/18636cea2bb745109bdaac603cacdc29, entries=2, sequenceid=9, filesize=5.0 K 2023-07-11 14:09:48,439 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 1a59eba5ceb1b37937c91647cca969e7 in 431ms, sequenceid=9, compaction requested=false 2023-07-11 14:09:48,439 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1a59eba5ceb1b37937c91647cca969e7: 2023-07-11 14:09:48,439 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:48,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:09:48,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:09:48,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-07-11 14:09:48,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-07-11 14:09:48,441 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,441 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:48,442 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:48,442 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:48,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:48,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:48,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-07-11 14:09:48,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b9e6c60[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:48,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-07-11 14:09:48,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,444 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-07-11 14:09:48,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-07-11 14:09:48,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:48,444 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,444 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:48,446 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-07-11 14:09:48,446 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,446 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:48,446 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-07-11 14:09:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:48,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-07-11 14:09:48,449 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-07-11 14:09:48,449 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:48,449 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:48,449 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,449 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:48,451 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,451 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:48,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,451 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,451 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:48,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,453 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:48,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-07-11 14:09:48,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:48,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:48,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:48,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-07-11 14:09:48,455 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:48,455 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:48,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:48,456 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:48,456 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:48,456 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,456 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,456 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,556 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:48,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:48,565 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-07-11 14:09:48,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-11 14:09:48,568 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-11 14:09:48,569 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:48,569 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085188569 2023-07-11 14:09:48,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:09:48,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-07-11 14:09:48,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 14:09:48,571 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x5b0d4988 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:48,581 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf7f42c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:48,581 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-07-11 14:09:49,412 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711ac6d367bee8c431fbc87a93cfa934a22 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711ac6d367bee8c431fbc87a93cfa934a22 2023-07-11 14:09:49,413 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 14:09:49,446 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:49,448 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:49,469 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:09:49,472 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:09:49,487 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/931c6014bbb64cc5bd47280d9c7a7cfc first=Optional[k0] last=Optional[k1] 2023-07-11 14:09:49,494 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/931c6014bbb64cc5bd47280d9c7a7cfc}] 2023-07-11 14:09:49,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/931c6014bbb64cc5bd47280d9c7a7cfc for inclusion in 1a59eba5ceb1b37937c91647cca969e7/family1 2023-07-11 14:09:49,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-07-11 14:09:49,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 14:09:49,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 1a59eba5ceb1b37937c91647cca969e7: 2023-07-11 14:09:49,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/931c6014bbb64cc5bd47280d9c7a7cfc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testScannerOnBulkLoadRefHFiles__f8cfcu7aah7si49jartttd27ttk7phf10lubnqvi5v9hmc03j3gramch8hmg881n/family1/931c6014bbb64cc5bd47280d9c7a7cfc 2023-07-11 14:09:49,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testScannerOnBulkLoadRefHFiles__f8cfcu7aah7si49jartttd27ttk7phf10lubnqvi5v9hmc03j3gramch8hmg881n/family1/931c6014bbb64cc5bd47280d9c7a7cfc as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_ 2023-07-11 14:09:49,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testScannerOnBulkLoadRefHFiles__f8cfcu7aah7si49jartttd27ttk7phf10lubnqvi5v9hmc03j3gramch8hmg881n/family1/931c6014bbb64cc5bd47280d9c7a7cfc into 1a59eba5ceb1b37937c91647cca969e7/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_ - updating store file list. 2023-07-11 14:09:49,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_ into 1a59eba5ceb1b37937c91647cca969e7/family1 2023-07-11 14:09:49,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testScannerOnBulkLoadRefHFiles__f8cfcu7aah7si49jartttd27ttk7phf10lubnqvi5v9hmc03j3gramch8hmg881n/family1/931c6014bbb64cc5bd47280d9c7a7cfc into 1a59eba5ceb1b37937c91647cca969e7/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_) 2023-07-11 14:09:49,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testScannerOnBulkLoadRefHFiles__f8cfcu7aah7si49jartttd27ttk7phf10lubnqvi5v9hmc03j3gramch8hmg881n/family1/931c6014bbb64cc5bd47280d9c7a7cfc 2023-07-11 14:09:49,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 14:09:49,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 14:09:49,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): 1a59eba5ceb1b37937c91647cca969e7/family1 is initiating minor compaction (all files) 2023-07-11 14:09:49,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@431796f7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:49,544 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1a59eba5ceb1b37937c91647cca969e7/family1 in testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:09:49,544 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/313352a1f04b4a1395c743e98a49eda1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/18636cea2bb745109bdaac603cacdc29, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/.tmp, totalSize=15.1 K 2023-07-11 14:09:49,545 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 313352a1f04b4a1395c743e98a49eda1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084587014 2023-07-11 14:09:49,545 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 18636cea2bb745109bdaac603cacdc29, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084587014 2023-07-11 14:09:49,546 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 96480761bde94d1ca825b8601cbf407d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084587014 2023-07-11 14:09:49,546 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 14:09:49,548 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:49,550 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202307114185ae460e914309a6d6ca42dddd15cb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202307114185ae460e914309a6d6ca42dddd15cb 2023-07-11 14:09:49,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711b8f9c3129838442ba9ef992fce29249a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711b8f9c3129838442ba9ef992fce29249a 2023-07-11 14:09:49,553 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-07-11 14:09:49,553 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 14:09:49,554 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-07-11 14:09:49,554 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 14:09:49,554 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:49,555 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-11 14:09:49,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 989 msec 2023-07-11 14:09:49,571 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1a59eba5ceb1b37937c91647cca969e7#family1#compaction#38 average throughput is 0.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:49,594 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=266 (was 262) - Thread LEAK? -, OpenFileDescriptor=627 (was 625) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=621 (was 649), ProcessCount=177 (was 177), AvailableMemoryMB=1161 (was 1311) 2023-07-11 14:09:49,605 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=266, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=621, ProcessCount=177, AvailableMemoryMB=1161 2023-07-11 14:09:49,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 14:09:49,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:49,610 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:09:49,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-07-11 14:09:49,611 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:09:49,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 14:09:49,613 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:49,613 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8 empty. 2023-07-11 14:09:49,614 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:49,614 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-07-11 14:09:49,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 14:09:49,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 14:09:50,022 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 14:09:50,024 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5454e394f36817f1220287023e7e6f8, NAME => 'testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:09:50,032 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:50,032 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing b5454e394f36817f1220287023e7e6f8, disabling compactions & flushes 2023-07-11 14:09:50,033 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,033 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,033 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. after waiting 0 ms 2023-07-11 14:09:50,033 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,033 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,033 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:50,035 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:09:50,036 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689084590036"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084590036"}]},"ts":"1689084590036"} 2023-07-11 14:09:50,038 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:09:50,039 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:09:50,039 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084590039"}]},"ts":"1689084590039"} 2023-07-11 14:09:50,041 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-07-11 14:09:50,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5454e394f36817f1220287023e7e6f8, ASSIGN}] 2023-07-11 14:09:50,046 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5454e394f36817f1220287023e7e6f8, ASSIGN 2023-07-11 14:09:50,047 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5454e394f36817f1220287023e7e6f8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:09:50,199 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b5454e394f36817f1220287023e7e6f8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:50,199 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689084590199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084590199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084590199"}]},"ts":"1689084590199"} 2023-07-11 14:09:50,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure b5454e394f36817f1220287023e7e6f8, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:09:50,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 14:09:50,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5454e394f36817f1220287023e7e6f8, NAME => 'testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:09:50,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:50,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:09:50,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:50,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:50,359 INFO [StoreOpener-b5454e394f36817f1220287023e7e6f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:50,361 DEBUG [StoreOpener-b5454e394f36817f1220287023e7e6f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1 2023-07-11 14:09:50,361 DEBUG [StoreOpener-b5454e394f36817f1220287023e7e6f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1 2023-07-11 14:09:50,362 INFO [StoreOpener-b5454e394f36817f1220287023e7e6f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5454e394f36817f1220287023e7e6f8 columnFamilyName family1 2023-07-11 14:09:50,364 INFO [StoreOpener-b5454e394f36817f1220287023e7e6f8-1] regionserver.HStore(310): Store=b5454e394f36817f1220287023e7e6f8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:09:50,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:50,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:50,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b5454e394f36817f1220287023e7e6f8 2023-07-11 14:09:50,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:09:50,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b5454e394f36817f1220287023e7e6f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68900657, jitterRate=0.026699796319007874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:09:50,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:50,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8., pid=37, masterSystemTime=1689084590353 2023-07-11 14:09:50,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,376 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b5454e394f36817f1220287023e7e6f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:50,376 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689084590376"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084590376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084590376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084590376"}]},"ts":"1689084590376"} 2023-07-11 14:09:50,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-11 14:09:50,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure b5454e394f36817f1220287023e7e6f8, server=jenkins-hbase9.apache.org,46743,1689084553537 in 177 msec 2023-07-11 14:09:50,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-07-11 14:09:50,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5454e394f36817f1220287023e7e6f8, ASSIGN in 336 msec 2023-07-11 14:09:50,383 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:09:50,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084590383"}]},"ts":"1689084590383"} 2023-07-11 14:09:50,384 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-07-11 14:09:50,392 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:09:50,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 784 msec 2023-07-11 14:09:50,404 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/.tmp/family1/7edb22798a2043c28e88a8707a365ba0 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/7edb22798a2043c28e88a8707a365ba0 2023-07-11 14:09:50,411 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1a59eba5ceb1b37937c91647cca969e7/family1 of 1a59eba5ceb1b37937c91647cca969e7 into 7edb22798a2043c28e88a8707a365ba0(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:50,411 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1a59eba5ceb1b37937c91647cca969e7: 2023-07-11 14:09:50,411 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1689084589544; duration=0sec 2023-07-11 14:09:50,412 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:50,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/313352a1f04b4a1395c743e98a49eda1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/18636cea2bb745109bdaac603cacdc29, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_] to archive 2023-07-11 14:09:50,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:50,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/313352a1f04b4a1395c743e98a49eda1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/313352a1f04b4a1395c743e98a49eda1 2023-07-11 14:09:50,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/18636cea2bb745109bdaac603cacdc29 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/18636cea2bb745109bdaac603cacdc29 2023-07-11 14:09:50,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/family1/96480761bde94d1ca825b8601cbf407d_SeqId_12_ 2023-07-11 14:09:50,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 14:09:50,717 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-07-11 14:09:50,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:50,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,749 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:50,749 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:50,749 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:50,749 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:50,750 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,750 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,751 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:50,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:50,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:50,752 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,753 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:50,753 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:50,753 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:50,753 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:50,753 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:50,754 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:50,754 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:50,754 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:50,754 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:50,755 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 14:09:50,807 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308ae76a7e9a094de7afcb65e04c182978 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308ae76a7e9a094de7afcb65e04c182978 2023-07-11 14:09:51,213 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/5520f7beb56b461aa17a32376c720f07 2023-07-11 14:09:51,220 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/5520f7beb56b461aa17a32376c720f07 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5520f7beb56b461aa17a32376c720f07 2023-07-11 14:09:51,238 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5520f7beb56b461aa17a32376c720f07, entries=1000, sequenceid=5, filesize=165.1 K 2023-07-11 14:09:51,240 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 485ms, sequenceid=5, compaction requested=false 2023-07-11 14:09:51,240 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:51,240 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:51,241 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:51,241 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:51,241 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:51,241 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,241 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:51,241 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:51,243 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,243 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:51,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:51,243 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,243 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:51,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:51,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:51,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:51,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:51,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fcb267c[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:51,245 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:51,245 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,246 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:51,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:51,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:51,247 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,247 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:51,254 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,254 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:51,254 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:51,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:51,257 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:51,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:51,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:51,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,257 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:51,259 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,259 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:51,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,259 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,254 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:51,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,262 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:51,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,264 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:51,264 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:51,264 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:51,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:51,264 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:51,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:51,265 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:51,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:51,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:51,266 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:51,266 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:51,366 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:51,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:51,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:51,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:51,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,374 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:51,374 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:51,374 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:51,374 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:51,374 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,374 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,376 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:51,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:51,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:51,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,377 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,377 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:51,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:51,377 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:51,377 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:51,377 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:51,377 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:51,377 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:51,377 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:51,377 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:51,377 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 14:09:51,803 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a4d001ddeac746d580257ef9f97b6dbf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128a4d001ddeac746d580257ef9f97b6dbf 2023-07-11 14:09:52,217 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/62876e60ac644b9e8dc16d603a64f016 2023-07-11 14:09:52,232 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/62876e60ac644b9e8dc16d603a64f016 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/62876e60ac644b9e8dc16d603a64f016 2023-07-11 14:09:52,243 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/62876e60ac644b9e8dc16d603a64f016, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 14:09:52,245 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 868ms, sequenceid=9, compaction requested=false 2023-07-11 14:09:52,245 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:52,245 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:52,245 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:52,245 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:52,245 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,245 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:52,245 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:52,247 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:52,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,247 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:52,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:52,250 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:52,250 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f02e428[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,251 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:52,252 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:52,252 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:52,252 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:09:52,259 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:52,260 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:52,260 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:52,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:52,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:52,260 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:52,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:52,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:52,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,261 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:52,263 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,263 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,263 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:52,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:52,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:52,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:52,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:52,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:52,264 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:52,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,267 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,277 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:52,277 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:52,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:52,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:52,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:52,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:52,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,279 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:52,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:52,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:52,280 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:52,280 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:52,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:52,380 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:52,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:52,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:52,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:52,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,389 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:52,389 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:52,389 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:52,389 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:52,390 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,390 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,392 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:52,392 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:52,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:52,393 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,393 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,394 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,394 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:52,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:52,395 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:52,395 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:52,395 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:52,395 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:52,413 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120130e19dc994dc4080b271f74951ebc2e3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120130e19dc994dc4080b271f74951ebc2e3 2023-07-11 14:09:52,820 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/4f95571010124faa865f35aa0bfcba96 2023-07-11 14:09:52,826 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/4f95571010124faa865f35aa0bfcba96 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/4f95571010124faa865f35aa0bfcba96 2023-07-11 14:09:52,831 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/4f95571010124faa865f35aa0bfcba96, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 14:09:52,832 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 437ms, sequenceid=13, compaction requested=true 2023-07-11 14:09:52,833 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:52,833 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:52,833 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:52,833 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:52,833 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,833 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:52,833 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:52,835 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,835 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,835 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:52,841 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:52,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:52,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1257cb09[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:52,844 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:52,844 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,846 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:52,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:52,846 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,847 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:52,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:52,848 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,848 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:52,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:52,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:52,848 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:52,849 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:52,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:52,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:52,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:52,852 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:52,852 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:52,852 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:52,852 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,852 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:52,853 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,853 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:52,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,854 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:52,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:52,854 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,856 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,859 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,859 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:52,859 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:52,859 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,859 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,859 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:52,859 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:52,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:52,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:52,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,859 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:52,860 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:52,860 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:52,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:52,960 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:52,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:52,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:52,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:52,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,978 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:52,978 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:52,978 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:52,978 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:52,978 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,978 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,981 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:52,981 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:52,981 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:52,981 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:52,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,982 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,983 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:52,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:52,983 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:52,983 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:52,983 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:52,983 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:52,983 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:52,983 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:52,983 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:52,983 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:53,009 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050feb2066d363484b8154585ae225652c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050feb2066d363484b8154585ae225652c 2023-07-11 14:09:53,420 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/181868f97ad64e6c9b949518899ee65d 2023-07-11 14:09:53,428 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/181868f97ad64e6c9b949518899ee65d as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/181868f97ad64e6c9b949518899ee65d 2023-07-11 14:09:53,435 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/181868f97ad64e6c9b949518899ee65d, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 14:09:53,436 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 453ms, sequenceid=17, compaction requested=true 2023-07-11 14:09:53,436 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:53,436 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:53,436 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:53,436 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:53,436 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,436 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:53,436 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:53,438 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,438 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:53,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:53,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:53,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:53,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a52484f[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:53,440 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:53,441 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,442 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,442 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:53,442 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:53,442 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:53,442 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,442 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:53,445 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,445 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,445 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:53,445 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:53,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:53,448 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:53,448 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:53,448 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:53,448 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,448 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:53,450 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,450 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:53,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,450 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:53,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,451 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,452 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,454 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:53,455 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:53,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:53,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:53,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:53,455 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:53,556 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:53,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:53,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:53,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:53,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,564 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:53,564 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:53,564 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:53,564 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:53,564 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,564 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,565 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,565 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:53,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:53,566 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,566 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,567 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:53,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,567 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:53,567 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:53,567 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:53,567 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:53,568 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:53,568 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:53,568 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:53,568 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:53,605 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c603056bc2c6433ca7b96f82f6819bc9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c603056bc2c6433ca7b96f82f6819bc9 2023-07-11 14:09:53,630 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/49249932d63f464f8aac9cf3ce4d4c97 2023-07-11 14:09:53,638 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/49249932d63f464f8aac9cf3ce4d4c97 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/49249932d63f464f8aac9cf3ce4d4c97 2023-07-11 14:09:53,649 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/49249932d63f464f8aac9cf3ce4d4c97, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 14:09:53,650 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 82ms, sequenceid=21, compaction requested=true 2023-07-11 14:09:53,650 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:53,650 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:53,650 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:53,650 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:53,650 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,650 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:53,650 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:53,654 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,654 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:53,655 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,655 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:53,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:53,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:53,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:53,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:53,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cbc7bbf[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:53,656 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:53,656 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,659 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,659 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:53,664 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,664 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:53,664 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:53,664 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:53,666 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:53,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:53,666 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:53,666 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:53,666 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:53,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:53,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:53,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:53,668 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:53,668 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:53,668 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:53,668 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,668 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:53,672 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,672 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:53,672 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:53,672 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:53,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,677 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,680 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,680 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,680 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:53,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:53,681 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:53,680 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:53,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:53,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:53,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:53,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,681 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:53,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,681 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:53,681 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:53,781 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:53,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:53,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:53,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:53,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,818 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:53,818 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:53,818 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:53,818 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:53,818 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,818 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,820 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,820 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:53,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:53,820 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:53,820 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:53,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,821 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,845 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:53,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:53,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:53,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:53,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:53,850 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:53,850 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:53,851 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:53,851 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:53,851 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:53,897 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318a71dac674884d1eb7b8da37feeffad8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512318a71dac674884d1eb7b8da37feeffad8 2023-07-11 14:09:54,312 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/c6ef1fc38f324aaf9b0f885ea08c444b 2023-07-11 14:09:54,318 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/c6ef1fc38f324aaf9b0f885ea08c444b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/c6ef1fc38f324aaf9b0f885ea08c444b 2023-07-11 14:09:54,323 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/c6ef1fc38f324aaf9b0f885ea08c444b, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 14:09:54,324 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 473ms, sequenceid=25, compaction requested=true 2023-07-11 14:09:54,324 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:54,324 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:54,324 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:54,324 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:54,324 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,324 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:54,324 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:54,326 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,326 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:54,326 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,326 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:54,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:54,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6487f3a4[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:54,329 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:54,329 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,331 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,332 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:54,332 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:54,332 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:54,332 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,332 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:54,333 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:54,333 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,333 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:54,333 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:54,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:54,336 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:54,336 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:54,336 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:54,336 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,336 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:54,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:54,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:54,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:54,338 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,339 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,341 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:54,342 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:54,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:54,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:54,342 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:54,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:54,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:54,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:54,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:54,342 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:54,342 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:54,343 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,343 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,343 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,343 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,343 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,343 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,343 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:54,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:54,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:54,443 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:54,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:54,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:54,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:54,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,450 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:54,451 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:54,451 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:54,451 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:54,451 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,451 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,454 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:54,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:54,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:54,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:54,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,455 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:54,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:54,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:54,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:54,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:54,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:54,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:54,456 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:54,456 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:54,456 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:54,874 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d9efb155565243779984cdba30abd9cc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d9efb155565243779984cdba30abd9cc 2023-07-11 14:09:55,309 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/9d0810757b3f40c89b3278183c513743 2023-07-11 14:09:55,315 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/9d0810757b3f40c89b3278183c513743 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/9d0810757b3f40c89b3278183c513743 2023-07-11 14:09:55,320 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/9d0810757b3f40c89b3278183c513743, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 14:09:55,321 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 865ms, sequenceid=29, compaction requested=true 2023-07-11 14:09:55,321 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:55,321 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:55,322 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:55,322 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:55,322 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,322 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:55,322 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:55,324 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,324 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:55,325 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:55,325 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:55,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:55,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48a473be[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:55,326 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:55,326 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,327 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,328 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:55,328 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:55,328 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:55,328 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,328 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:55,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:55,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:55,333 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:55,333 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:55,333 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:55,333 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,333 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:55,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:55,335 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,337 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,338 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:55,338 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:55,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,338 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:55,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:55,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,350 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:55,350 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:55,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:55,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:55,350 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,350 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:55,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:55,350 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:55,350 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:55,350 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,351 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:55,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:55,351 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:55,351 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,351 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,351 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,451 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:55,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:55,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:55,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:55,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,461 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:55,461 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:55,461 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:55,461 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:55,462 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,462 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,466 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,466 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:55,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:55,467 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:55,467 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:55,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,468 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,468 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:55,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:55,468 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:55,468 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:55,468 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:55,468 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:55,468 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:55,468 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:55,468 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:55,468 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:55,890 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c653ab182ba741828a2e0930314d51e3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c653ab182ba741828a2e0930314d51e3 2023-07-11 14:09:56,297 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/f6e3e6ed1b0a489892a1bc8dc79217a3 2023-07-11 14:09:56,303 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/f6e3e6ed1b0a489892a1bc8dc79217a3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/f6e3e6ed1b0a489892a1bc8dc79217a3 2023-07-11 14:09:56,309 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/f6e3e6ed1b0a489892a1bc8dc79217a3, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 14:09:56,310 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 842ms, sequenceid=33, compaction requested=true 2023-07-11 14:09:56,310 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:56,310 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:56,310 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:56,311 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:56,311 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,311 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:56,311 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:56,312 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:56,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:56,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:56,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@304c5ad5[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:56,315 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:56,315 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,316 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,316 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:56,316 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:56,316 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,317 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:56,316 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:56,318 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,318 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:56,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:56,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:56,318 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:56,318 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:56,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:56,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:56,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:56,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:56,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:56,321 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:56,321 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:56,321 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:56,321 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,321 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:56,324 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,324 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:56,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:56,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,324 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:56,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:56,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:56,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:56,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,325 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:56,327 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:56,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:56,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,330 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:56,331 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,330 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:56,331 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:56,431 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:56,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:56,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:56,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:56,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,439 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:56,439 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:56,440 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:56,440 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:56,441 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,441 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,442 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:56,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:56,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:56,442 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:56,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:56,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,444 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:56,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:56,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:56,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:56,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:56,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:56,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:56,444 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:56,445 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:56,445 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:56,870 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074fbd9d2befce44708d71ab4da98cf91c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509074fbd9d2befce44708d71ab4da98cf91c 2023-07-11 14:09:57,276 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/3827ffd8ee8949d7b2e1ddafb13acfdf 2023-07-11 14:09:57,282 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/3827ffd8ee8949d7b2e1ddafb13acfdf as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/3827ffd8ee8949d7b2e1ddafb13acfdf 2023-07-11 14:09:57,287 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/3827ffd8ee8949d7b2e1ddafb13acfdf, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 14:09:57,288 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 843ms, sequenceid=37, compaction requested=true 2023-07-11 14:09:57,288 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:57,288 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:57,288 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:57,288 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:57,288 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,288 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:57,288 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:57,291 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,291 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:57,291 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:57,291 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:57,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:57,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fb2aee0[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:57,293 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:57,293 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,294 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,294 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:57,294 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,295 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:57,294 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:57,295 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:57,297 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:57,297 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,297 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:57,297 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:57,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:57,300 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:57,300 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:57,300 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:57,300 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,300 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:57,302 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,302 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:57,302 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:57,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,303 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,304 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:57,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:57,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:57,308 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:57,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,308 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:57,309 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,309 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,409 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:57,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:57,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:09:57,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:09:57,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,454 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:57,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:57,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 14:09:57,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 14:09:57,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,456 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,456 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:57,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:57,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:57,456 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:57,456 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:09:57,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:09:57,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,469 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 14:09:57,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:57,470 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 14:09:57,470 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:09:57,470 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 14:09:57,474 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:09:57,474 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:09:57,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:57,475 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. started... 2023-07-11 14:09:57,475 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5454e394f36817f1220287023e7e6f8 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:09:57,903 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112014cc6417d0324adbbe6ed4d22f8a6bf5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112014cc6417d0324adbbe6ed4d22f8a6bf5 2023-07-11 14:09:58,312 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/5369f82327924fcd9e2b2b67da9ee992 2023-07-11 14:09:58,319 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/5369f82327924fcd9e2b2b67da9ee992 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5369f82327924fcd9e2b2b67da9ee992 2023-07-11 14:09:58,326 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5369f82327924fcd9e2b2b67da9ee992, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 14:09:58,327 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5454e394f36817f1220287023e7e6f8 in 852ms, sequenceid=41, compaction requested=true 2023-07-11 14:09:58,327 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:58,327 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:58,327 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:09:58,328 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:09:58,328 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,328 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 14:09:58,328 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 14:09:58,330 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:58,332 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:58,333 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,333 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:09:58,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 14:09:58,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f36261[Count = 0] remaining members to acquire global barrier 2023-07-11 14:09:58,334 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 14:09:58,334 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,336 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 14:09:58,336 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 14:09:58,336 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:09:58,336 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,336 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:09:58,337 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 14:09:58,337 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:58,337 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 14:09:58,337 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:09:58,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:09:58,341 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 14:09:58,341 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:09:58,341 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:09:58,341 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,341 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:09:58,349 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,349 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:58,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,349 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:09:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:09:58,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:09:58,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,351 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:09:58,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,352 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:09:58,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,358 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,358 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,358 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,358 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:09:58,358 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:09:58,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:09:58,359 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:09:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:09:58,359 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,359 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:09:58,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 14:09:58,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:09:58,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 14:09:58,359 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,359 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,359 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:09:58,359 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:09:58,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:09:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:09:58,460 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:09:58,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:09:58,463 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-07-11 14:09:58,468 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:58,469 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:58,473 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085198473 2023-07-11 14:09:58,473 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:58,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:09:58,475 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-07-11 14:09:58,475 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:58,476 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x0878b308 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:09:58,480 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b7d70bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:09:58,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,544 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103edc558136bc64cf89fcae1714770f13a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103edc558136bc64cf89fcae1714770f13a 2023-07-11 14:09:58,550 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:58,565 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:09:58,566 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:09:58,574 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:09:58,576 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:09:58,632 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fc65dac58248d9ac829a1332368ca3 first=Optional[r3] last=Optional[r6] 2023-07-11 14:09:58,632 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fc65dac58248d9ac829a1332368ca3}] 2023-07-11 14:09:58,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fc65dac58248d9ac829a1332368ca3 for inclusion in b5454e394f36817f1220287023e7e6f8/family1 2023-07-11 14:09:58,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 14:09:58,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:58,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:58,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fc65dac58248d9ac829a1332368ca3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d65ucfmrrgtul3naklv8u468dgk6v6o0uvmimlh642t9gnt2di4a32r8l3i7ncu1/family1/89fc65dac58248d9ac829a1332368ca3 2023-07-11 14:09:58,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d65ucfmrrgtul3naklv8u468dgk6v6o0uvmimlh642t9gnt2di4a32r8l3i7ncu1/family1/89fc65dac58248d9ac829a1332368ca3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_ 2023-07-11 14:09:58,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d65ucfmrrgtul3naklv8u468dgk6v6o0uvmimlh642t9gnt2di4a32r8l3i7ncu1/family1/89fc65dac58248d9ac829a1332368ca3 into b5454e394f36817f1220287023e7e6f8/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_ - updating store file list. 2023-07-11 14:09:58,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_ into b5454e394f36817f1220287023e7e6f8/family1 2023-07-11 14:09:58,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d65ucfmrrgtul3naklv8u468dgk6v6o0uvmimlh642t9gnt2di4a32r8l3i7ncu1/family1/89fc65dac58248d9ac829a1332368ca3 into b5454e394f36817f1220287023e7e6f8/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_) 2023-07-11 14:09:58,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d65ucfmrrgtul3naklv8u468dgk6v6o0uvmimlh642t9gnt2di4a32r8l3i7ncu1/family1/89fc65dac58248d9ac829a1332368ca3 2023-07-11 14:09:58,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 14:09:58,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 14:09:58,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): b5454e394f36817f1220287023e7e6f8/family1 is initiating minor compaction 2023-07-11 14:09:58,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@35e095c1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:58,661 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5454e394f36817f1220287023e7e6f8/family1 in testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:58,661 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/62876e60ac644b9e8dc16d603a64f016, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/4f95571010124faa865f35aa0bfcba96, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/181868f97ad64e6c9b949518899ee65d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/49249932d63f464f8aac9cf3ce4d4c97, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/c6ef1fc38f324aaf9b0f885ea08c444b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/9d0810757b3f40c89b3278183c513743, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/f6e3e6ed1b0a489892a1bc8dc79217a3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/3827ffd8ee8949d7b2e1ddafb13acfdf, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5369f82327924fcd9e2b2b67da9ee992, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp, totalSize=50.0 K 2023-07-11 14:09:58,661 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 62876e60ac644b9e8dc16d603a64f016, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:09:58,661 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 4f95571010124faa865f35aa0bfcba96, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:09:58,661 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 181868f97ad64e6c9b949518899ee65d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 14:09:58,661 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 49249932d63f464f8aac9cf3ce4d4c97, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 14:09:58,661 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting c6ef1fc38f324aaf9b0f885ea08c444b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 14:09:58,661 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 9d0810757b3f40c89b3278183c513743, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 14:09:58,662 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting f6e3e6ed1b0a489892a1bc8dc79217a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 14:09:58,662 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 3827ffd8ee8949d7b2e1ddafb13acfdf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 14:09:58,662 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 5369f82327924fcd9e2b2b67da9ee992, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 14:09:58,662 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting d83c2b164f89428eaf584b0df746f2f1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 14:09:58,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:58,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:58,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c603056bc2c6433ca7b96f82f6819bc9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c603056bc2c6433ca7b96f82f6819bc9 2023-07-11 14:09:58,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512318a71dac674884d1eb7b8da37feeffad8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512318a71dac674884d1eb7b8da37feeffad8 2023-07-11 14:09:58,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d9efb155565243779984cdba30abd9cc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d9efb155565243779984cdba30abd9cc 2023-07-11 14:09:58,686 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c653ab182ba741828a2e0930314d51e3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c653ab182ba741828a2e0930314d51e3 2023-07-11 14:09:58,686 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-07-11 14:09:58,686 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:58,759 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:09:58,759 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b0d4988 to 127.0.0.1:63702 2023-07-11 14:09:58,759 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:09:58,760 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:09:58,760 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d68e56d to 127.0.0.1:63702 2023-07-11 14:09:58,760 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:09:58,760 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:09:58,760 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e07f602 to 127.0.0.1:63702 2023-07-11 14:09:58,760 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:09:58,767 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5454e394f36817f1220287023e7e6f8#family1#compaction#49 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:59,234 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/265be02542094208bba6736a6715113f as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/265be02542094208bba6736a6715113f 2023-07-11 14:09:59,241 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b5454e394f36817f1220287023e7e6f8/family1 of b5454e394f36817f1220287023e7e6f8 into 265be02542094208bba6736a6715113f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:09:59,241 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:59,241 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1689084598660; duration=0sec 2023-07-11 14:09:59,241 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:59,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/62876e60ac644b9e8dc16d603a64f016, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/4f95571010124faa865f35aa0bfcba96, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/181868f97ad64e6c9b949518899ee65d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/49249932d63f464f8aac9cf3ce4d4c97, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/c6ef1fc38f324aaf9b0f885ea08c444b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/9d0810757b3f40c89b3278183c513743, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/f6e3e6ed1b0a489892a1bc8dc79217a3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/3827ffd8ee8949d7b2e1ddafb13acfdf, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5369f82327924fcd9e2b2b67da9ee992, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_] to archive 2023-07-11 14:09:59,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:59,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/62876e60ac644b9e8dc16d603a64f016 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/62876e60ac644b9e8dc16d603a64f016 2023-07-11 14:09:59,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/4f95571010124faa865f35aa0bfcba96 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/4f95571010124faa865f35aa0bfcba96 2023-07-11 14:09:59,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/181868f97ad64e6c9b949518899ee65d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/181868f97ad64e6c9b949518899ee65d 2023-07-11 14:09:59,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/49249932d63f464f8aac9cf3ce4d4c97 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/49249932d63f464f8aac9cf3ce4d4c97 2023-07-11 14:09:59,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/c6ef1fc38f324aaf9b0f885ea08c444b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/c6ef1fc38f324aaf9b0f885ea08c444b 2023-07-11 14:09:59,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/9d0810757b3f40c89b3278183c513743 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/9d0810757b3f40c89b3278183c513743 2023-07-11 14:09:59,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/f6e3e6ed1b0a489892a1bc8dc79217a3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/f6e3e6ed1b0a489892a1bc8dc79217a3 2023-07-11 14:09:59,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/3827ffd8ee8949d7b2e1ddafb13acfdf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/3827ffd8ee8949d7b2e1ddafb13acfdf 2023-07-11 14:09:59,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5369f82327924fcd9e2b2b67da9ee992 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5369f82327924fcd9e2b2b67da9ee992 2023-07-11 14:09:59,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/d83c2b164f89428eaf584b0df746f2f1_SeqId_44_ 2023-07-11 14:09:59,607 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120513571c946e5a477e92b63567b3fbc770 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120513571c946e5a477e92b63567b3fbc770 2023-07-11 14:09:59,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:59,633 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4af0db3b2a01419fae94d108f467ddf9 first=Optional[r00] last=Optional[r2] 2023-07-11 14:09:59,633 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4af0db3b2a01419fae94d108f467ddf9}] 2023-07-11 14:09:59,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4af0db3b2a01419fae94d108f467ddf9 for inclusion in b5454e394f36817f1220287023e7e6f8/family1 2023-07-11 14:09:59,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 14:09:59,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:09:59,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:09:59,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4af0db3b2a01419fae94d108f467ddf9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8jd2nfhshihkhda47qaorigc8usr49kdfp8r7aubrjbi7mqcrvarj518o684v2du/family1/4af0db3b2a01419fae94d108f467ddf9 2023-07-11 14:09:59,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8jd2nfhshihkhda47qaorigc8usr49kdfp8r7aubrjbi7mqcrvarj518o684v2du/family1/4af0db3b2a01419fae94d108f467ddf9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_ 2023-07-11 14:09:59,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8jd2nfhshihkhda47qaorigc8usr49kdfp8r7aubrjbi7mqcrvarj518o684v2du/family1/4af0db3b2a01419fae94d108f467ddf9 into b5454e394f36817f1220287023e7e6f8/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_ - updating store file list. 2023-07-11 14:09:59,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_ into b5454e394f36817f1220287023e7e6f8/family1 2023-07-11 14:09:59,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8jd2nfhshihkhda47qaorigc8usr49kdfp8r7aubrjbi7mqcrvarj518o684v2du/family1/4af0db3b2a01419fae94d108f467ddf9 into b5454e394f36817f1220287023e7e6f8/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_) 2023-07-11 14:09:59,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8jd2nfhshihkhda47qaorigc8usr49kdfp8r7aubrjbi7mqcrvarj518o684v2du/family1/4af0db3b2a01419fae94d108f467ddf9 2023-07-11 14:09:59,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 14:09:59,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 14:09:59,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): b5454e394f36817f1220287023e7e6f8/family1 is initiating minor compaction (all files) 2023-07-11 14:09:59,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3ae338d2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:09:59,651 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5454e394f36817f1220287023e7e6f8/family1 in testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:09:59,651 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5520f7beb56b461aa17a32376c720f07, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/265be02542094208bba6736a6715113f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp, totalSize=337.0 K 2023-07-11 14:09:59,652 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 5520f7beb56b461aa17a32376c720f07, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878818110 2023-07-11 14:09:59,652 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 265be02542094208bba6736a6715113f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621218110 2023-07-11 14:09:59,653 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting defe5c2ade15495a937705dbdc2207f8_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878818110 2023-07-11 14:09:59,653 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:59,654 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:09:59,656 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308ae76a7e9a094de7afcb65e04c182978 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308ae76a7e9a094de7afcb65e04c182978 2023-07-11 14:09:59,657 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120130e19dc994dc4080b271f74951ebc2e3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120130e19dc994dc4080b271f74951ebc2e3 2023-07-11 14:09:59,659 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050feb2066d363484b8154585ae225652c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050feb2066d363484b8154585ae225652c 2023-07-11 14:09:59,660 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-07-11 14:09:59,660 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 14:09:59,660 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 14:09:59,660 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 14:09:59,660 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:09:59,661 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:09:59,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.1980 sec 2023-07-11 14:09:59,670 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5454e394f36817f1220287023e7e6f8#family1#compaction#50 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:09:59,778 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=261 (was 266), OpenFileDescriptor=617 (was 627), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=604 (was 621), ProcessCount=181 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=907 (was 1161) 2023-07-11 14:09:59,789 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=261, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=604, ProcessCount=181, AvailableMemoryMB=907 2023-07-11 14:09:59,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 14:09:59,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:09:59,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:09:59,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-07-11 14:09:59,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:09:59,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 14:09:59,795 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:09:59,796 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a empty. 2023-07-11 14:09:59,796 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:09:59,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-07-11 14:09:59,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 14:10:00,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 14:10:00,205 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:00,206 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => f398ea8794712f0784dc2726308bb40a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:00,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 14:10:00,612 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:00,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing f398ea8794712f0784dc2726308bb40a, disabling compactions & flushes 2023-07-11 14:10:00,613 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:00,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:00,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. after waiting 0 ms 2023-07-11 14:10:00,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:00,613 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:00,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:00,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:10:00,616 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084600616"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084600616"}]},"ts":"1689084600616"} 2023-07-11 14:10:00,618 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:10:00,619 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:10:00,619 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084600619"}]},"ts":"1689084600619"} 2023-07-11 14:10:00,620 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-07-11 14:10:00,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, ASSIGN}] 2023-07-11 14:10:00,624 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, ASSIGN 2023-07-11 14:10:00,625 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:00,776 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:00,776 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084600776"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084600776"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084600776"}]},"ts":"1689084600776"} 2023-07-11 14:10:00,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:00,895 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/.tmp/family1/f0b3c51d7dd44199bffc660d7e3fa9d5 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/f0b3c51d7dd44199bffc660d7e3fa9d5 2023-07-11 14:10:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 14:10:00,900 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5454e394f36817f1220287023e7e6f8/family1 of b5454e394f36817f1220287023e7e6f8 into f0b3c51d7dd44199bffc660d7e3fa9d5(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 14:10:00,900 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:10:00,900 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1689084599651; duration=1sec 2023-07-11 14:10:00,900 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:00,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:00,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f398ea8794712f0784dc2726308bb40a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:10:00,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:00,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:00,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:00,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:00,934 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:00,935 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:00,935 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:00,936 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f398ea8794712f0784dc2726308bb40a columnFamilyName family1 2023-07-11 14:10:00,937 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(310): Store=f398ea8794712f0784dc2726308bb40a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:00,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:00,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:00,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:00,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5520f7beb56b461aa17a32376c720f07, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/265be02542094208bba6736a6715113f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_] to archive 2023-07-11 14:10:00,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:00,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:00,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f398ea8794712f0784dc2726308bb40a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61067318, jitterRate=-0.09002605080604553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:10:00,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:00,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5520f7beb56b461aa17a32376c720f07 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/5520f7beb56b461aa17a32376c720f07 2023-07-11 14:10:00,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., pid=41, masterSystemTime=1689084600930 2023-07-11 14:10:00,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/265be02542094208bba6736a6715113f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/265be02542094208bba6736a6715113f 2023-07-11 14:10:00,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:00,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:00,948 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:00,948 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084600948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084600948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084600948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084600948"}]},"ts":"1689084600948"} 2023-07-11 14:10:00,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/family1/defe5c2ade15495a937705dbdc2207f8_SeqId_47_ 2023-07-11 14:10:00,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-07-11 14:10:00,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 172 msec 2023-07-11 14:10:00,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-07-11 14:10:00,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, ASSIGN in 329 msec 2023-07-11 14:10:00,954 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:10:00,954 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084600954"}]},"ts":"1689084600954"} 2023-07-11 14:10:00,955 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-07-11 14:10:00,957 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:10:00,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1660 sec 2023-07-11 14:10:01,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 14:10:01,900 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-07-11 14:10:01,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:01,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,924 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:01,924 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:01,924 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:01,924 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:01,925 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,925 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:01,926 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:01,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:01,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:01,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:01,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:01,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,927 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:01,927 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:01,927 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:01,927 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:01,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:01,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:01,928 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:01,928 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:01,928 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 14:10:02,356 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113055dcfdf1ac46494e8bf7c6d3f7144249 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113055dcfdf1ac46494e8bf7c6d3f7144249 2023-07-11 14:10:02,760 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/c19360afa2714851929506e61f4394af 2023-07-11 14:10:02,765 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/c19360afa2714851929506e61f4394af as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/c19360afa2714851929506e61f4394af 2023-07-11 14:10:02,769 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/c19360afa2714851929506e61f4394af, entries=1000, sequenceid=5, filesize=191.4 K 2023-07-11 14:10:02,770 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 842ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:02,770 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:02,770 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:02,770 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:02,771 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:02,771 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:02,771 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,771 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:02,771 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:02,772 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,772 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:02,773 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,773 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:02,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:02,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fa1d6c2[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:02,774 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:02,774 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,775 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,775 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:02,775 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:02,775 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,775 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:02,775 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:02,777 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:02,777 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,777 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:02,777 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:02,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:02,779 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:02,779 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:02,779 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:02,779 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,779 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:02,783 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,783 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,783 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,784 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,785 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,787 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:02,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:02,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:02,787 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:02,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 14:10:02,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:02,887 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:02,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:02,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:02,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:02,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,895 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:02,895 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:02,895 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:02,895 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:02,895 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,895 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,896 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:02,896 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:02,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:02,897 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:02,897 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:02,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:02,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,897 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,898 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:02,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:02,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:02,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:02,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:02,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:02,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:02,898 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:02,898 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:02,898 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 14:10:03,317 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112850794016f36246debc2d45d2965595b5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112850794016f36246debc2d45d2965595b5 2023-07-11 14:10:03,323 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/02ecae2ad982423381cc09d8ca615fee 2023-07-11 14:10:03,335 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/02ecae2ad982423381cc09d8ca615fee as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/02ecae2ad982423381cc09d8ca615fee 2023-07-11 14:10:03,339 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/02ecae2ad982423381cc09d8ca615fee, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 14:10:03,340 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 442ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:03,340 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:03,340 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:03,340 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:03,340 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:03,340 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,340 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:03,340 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:03,342 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,342 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,343 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,343 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:03,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:03,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4de9bd11[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:03,345 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:03,345 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,347 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,347 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:03,347 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:03,347 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:03,347 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,347 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:03,348 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,348 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,348 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:03,349 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:03,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:03,358 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:03,358 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:03,358 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:03,358 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,358 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:03,361 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,361 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,361 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:03,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:03,362 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,363 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,370 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,370 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,370 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,370 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,371 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,371 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 14:10:03,371 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:03,371 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:03,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:03,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:03,371 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,371 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:03,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:03,371 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:03,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:03,372 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:03,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:03,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:03,472 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:03,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:03,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:03,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:03,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,480 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:03,480 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:03,480 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:03,480 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:03,481 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,481 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,483 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:03,483 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:03,483 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,483 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:03,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,484 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:03,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,485 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:03,485 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:03,485 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:03,485 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:03,485 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:03,485 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:03,485 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:03,485 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:03,506 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120129a2c90e24ea465982de0a5ba43f3f7f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120129a2c90e24ea465982de0a5ba43f3f7f 2023-07-11 14:10:03,516 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/386ffac6377b4223877da27cc1a56c73 2023-07-11 14:10:03,522 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/386ffac6377b4223877da27cc1a56c73 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/386ffac6377b4223877da27cc1a56c73 2023-07-11 14:10:03,527 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/386ffac6377b4223877da27cc1a56c73, entries=1, sequenceid=13, filesize=5.0 K 2023-07-11 14:10:03,528 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 43ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:03,528 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:03,528 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:03,528 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:03,528 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:03,528 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,528 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:03,528 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:03,531 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,531 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,531 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,531 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:03,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7796cfe2[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:03,538 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:03,538 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,540 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,541 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:03,541 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:03,541 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:03,541 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,541 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:03,542 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:03,543 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:03,543 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:03,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:03,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:03,546 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:03,546 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:03,546 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:03,546 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,546 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:03,555 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,555 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:03,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,560 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,561 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,564 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,573 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,573 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,574 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,574 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,574 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,574 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,574 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,574 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:03,574 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:03,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:03,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:03,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:03,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:03,574 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:03,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:03,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:03,581 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:03,582 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:03,682 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:03,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:03,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:03,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:03,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,692 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:03,693 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:03,693 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:03,693 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:03,693 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,693 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,695 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:03,695 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:03,695 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,695 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,704 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:03,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,704 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:03,704 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:03,704 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:03,705 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:03,705 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:03,705 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:03,706 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:03,706 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:03,767 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dfc62df4b6814a7797a7166d60bec12b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dfc62df4b6814a7797a7166d60bec12b 2023-07-11 14:10:03,779 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/d0ba4a8cd7c447d487606a1574dc71cb 2023-07-11 14:10:03,786 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/d0ba4a8cd7c447d487606a1574dc71cb as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/d0ba4a8cd7c447d487606a1574dc71cb 2023-07-11 14:10:03,791 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/d0ba4a8cd7c447d487606a1574dc71cb, entries=1, sequenceid=17, filesize=5.0 K 2023-07-11 14:10:03,792 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 86ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:03,792 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:03,792 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:03,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:03,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:03,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:03,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:03,794 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,794 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,795 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,795 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:03,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:03,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18994b1b[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:03,801 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:03,801 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,803 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,804 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:03,804 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:03,804 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:03,804 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,804 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:03,805 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,805 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:03,805 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:03,805 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:03,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:03,809 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:03,809 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:03,809 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:03,809 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,809 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:03,814 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,814 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:03,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,814 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:03,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:03,816 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:03,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,818 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,821 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:03,821 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:03,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:03,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:03,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:03,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:03,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:03,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:03,825 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:03,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,825 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,826 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:03,826 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:03,926 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:03,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:03,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:03,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:03,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,935 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:03,935 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:03,935 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:03,935 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:03,935 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,935 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,939 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:03,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,941 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,949 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,950 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:03,950 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:03,953 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:03,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:03,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:03,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:03,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:03,958 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:03,958 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:03,958 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:03,958 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:03,958 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:03,985 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122875783bc4d26944b9b13663fef6146c48 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122875783bc4d26944b9b13663fef6146c48 2023-07-11 14:10:04,394 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/5618d4cd4d3040c386c94a72ec9f5acd 2023-07-11 14:10:04,399 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/5618d4cd4d3040c386c94a72ec9f5acd as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/5618d4cd4d3040c386c94a72ec9f5acd 2023-07-11 14:10:04,404 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/5618d4cd4d3040c386c94a72ec9f5acd, entries=1, sequenceid=21, filesize=5.0 K 2023-07-11 14:10:04,405 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 447ms, sequenceid=21, compaction requested=true 2023-07-11 14:10:04,405 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:04,405 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:04,405 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:04,405 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:04,405 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,405 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:04,405 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:04,410 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,410 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:04,410 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:04,410 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:04,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:04,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@99f890c[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:04,412 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:04,412 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,413 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,413 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:04,413 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:04,413 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:04,413 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,413 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:04,415 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,415 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:04,415 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:04,415 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:04,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:04,417 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:04,417 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:04,417 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:04,417 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,417 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:04,419 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,419 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:04,419 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:04,420 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,421 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:04,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 14:10:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:04,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:04,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:04,424 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,424 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:04,425 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:04,425 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:04,525 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:04,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:04,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:04,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:04,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,532 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:04,532 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:04,532 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:04,532 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:04,532 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,532 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,534 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:04,534 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:04,534 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:04,534 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:04,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,535 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:04,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:04,535 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:04,535 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:04,535 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:04,536 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:04,536 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:04,536 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:04,536 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:04,536 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:04,949 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123137e987febb0a4c9482e9aa8d44242b6b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123137e987febb0a4c9482e9aa8d44242b6b 2023-07-11 14:10:05,356 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/7b443a2ae4a94dd89ff680174f7a19a3 2023-07-11 14:10:05,361 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/7b443a2ae4a94dd89ff680174f7a19a3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/7b443a2ae4a94dd89ff680174f7a19a3 2023-07-11 14:10:05,365 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/7b443a2ae4a94dd89ff680174f7a19a3, entries=1, sequenceid=25, filesize=5.0 K 2023-07-11 14:10:05,366 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 830ms, sequenceid=25, compaction requested=true 2023-07-11 14:10:05,366 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:05,366 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:05,366 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:05,366 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:05,366 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:05,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:05,368 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,368 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:05,369 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,369 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:05,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:05,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@91eac1b[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:05,370 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:05,370 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,372 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,372 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:05,372 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:05,372 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:05,372 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,372 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:05,374 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,374 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:05,374 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:05,374 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:05,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:05,376 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:05,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:05,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:05,376 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,376 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:05,378 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,378 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:05,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:05,378 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:05,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:05,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:05,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:05,379 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:05,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,380 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,383 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,383 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:05,383 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:05,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:05,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:05,384 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:05,383 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,383 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:05,384 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,384 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,384 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 14:10:05,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:05,384 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:05,384 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:05,384 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,484 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:05,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:05,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,491 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:05,491 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:05,491 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:05,491 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:05,492 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,492 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,493 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:05,493 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:05,493 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:05,493 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,494 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,494 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:05,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:05,494 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:05,495 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:05,495 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:05,495 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:05,495 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:05,495 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:05,495 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:05,495 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:05,910 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010175f2e9872883461299cb0f3b3388888b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010175f2e9872883461299cb0f3b3388888b 2023-07-11 14:10:06,317 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/22f73f8cc8d64fbcbae03aa6e32075a4 2023-07-11 14:10:06,322 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/22f73f8cc8d64fbcbae03aa6e32075a4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/22f73f8cc8d64fbcbae03aa6e32075a4 2023-07-11 14:10:06,326 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/22f73f8cc8d64fbcbae03aa6e32075a4, entries=1, sequenceid=29, filesize=5.0 K 2023-07-11 14:10:06,326 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 831ms, sequenceid=29, compaction requested=true 2023-07-11 14:10:06,327 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:06,327 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:06,327 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:06,327 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:06,327 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,327 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:06,327 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:06,328 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,329 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:06,329 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,329 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:06,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:06,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48369b05[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:06,330 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:06,330 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,331 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,332 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:06,332 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:06,332 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,332 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:06,332 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:06,334 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,334 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:06,335 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:06,335 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:06,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:06,337 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:06,337 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:06,337 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:06,337 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,337 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:06,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,338 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:06,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:06,339 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,340 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,344 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,344 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:06,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:06,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:06,345 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:06,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:06,345 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:06,445 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:06,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:06,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:06,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:06,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,452 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:06,452 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:06,452 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:06,452 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:06,453 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,453 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,455 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:06,455 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:06,455 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,455 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:06,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,456 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,456 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:06,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:06,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:06,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:06,457 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:06,457 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:06,457 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:06,457 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:06,457 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:06,475 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:10:06,872 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103314dc2dc931e41ce8d1ad6ab7ed9ea3d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103314dc2dc931e41ce8d1ad6ab7ed9ea3d 2023-07-11 14:10:06,882 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/f89f1bf7198a4cc7b0f6688399b53c9e 2023-07-11 14:10:06,886 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/f89f1bf7198a4cc7b0f6688399b53c9e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f89f1bf7198a4cc7b0f6688399b53c9e 2023-07-11 14:10:06,890 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f89f1bf7198a4cc7b0f6688399b53c9e, entries=1, sequenceid=33, filesize=5.0 K 2023-07-11 14:10:06,891 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 434ms, sequenceid=33, compaction requested=true 2023-07-11 14:10:06,891 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:06,891 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:06,891 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:06,892 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:06,892 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,892 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:06,892 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:06,893 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,893 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:06,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:06,894 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,894 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:06,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:06,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:06,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:06,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:06,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1aa5d08b[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:06,895 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:06,896 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,897 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,897 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:06,897 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:06,897 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:06,897 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,897 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:06,898 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:06,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:06,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:06,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:06,898 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:06,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:06,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:06,906 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:06,906 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:06,906 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:06,906 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,906 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:06,908 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,908 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,908 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:06,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:06,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:06,909 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,910 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:06,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:06,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,912 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:06,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 14:10:06,913 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:06,913 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:06,912 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:06,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:06,913 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,013 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:07,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:07,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:07,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:07,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,022 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:07,022 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:07,022 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:07,022 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:07,023 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,023 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,024 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:07,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:07,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:07,025 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,025 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,026 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:07,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,026 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:07,026 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:07,026 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:07,026 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:07,026 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:07,026 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:07,026 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:07,026 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:07,042 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907eaaf371363374e798b242b40b9b14d46 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907eaaf371363374e798b242b40b9b14d46 2023-07-11 14:10:07,052 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/8508a8fdbf0a459bbcee914678cf457d 2023-07-11 14:10:07,057 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/8508a8fdbf0a459bbcee914678cf457d as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/8508a8fdbf0a459bbcee914678cf457d 2023-07-11 14:10:07,062 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/8508a8fdbf0a459bbcee914678cf457d, entries=1, sequenceid=37, filesize=5.0 K 2023-07-11 14:10:07,063 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 37ms, sequenceid=37, compaction requested=true 2023-07-11 14:10:07,063 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:07,063 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:07,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:07,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:07,063 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,064 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:07,064 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:07,065 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,065 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:07,066 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,066 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:07,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:07,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f07fd3a[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:07,068 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:07,068 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,070 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,070 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:07,071 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:07,071 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,071 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:07,071 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:07,072 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,072 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:07,072 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:07,072 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:07,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:07,074 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:07,074 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:07,075 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:07,075 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,075 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:07,076 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,076 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:07,076 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:07,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:07,077 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,078 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,081 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:07,081 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:07,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:07,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:07,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:07,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:07,081 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:07,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:07,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:07,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 14:10:07,081 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,082 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,182 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:07,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:07,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:07,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:07,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,191 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:07,191 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:07,191 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 14:10:07,191 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 14:10:07,192 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,192 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,200 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,200 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:07,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:07,200 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:07,200 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:07,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,202 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 14:10:07,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 14:10:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 14:10:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:07,210 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:07,210 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. started... 2023-07-11 14:10:07,210 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f398ea8794712f0784dc2726308bb40a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:07,628 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201d516b34a3c84535837c55ee750e8f92 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511201d516b34a3c84535837c55ee750e8f92 2023-07-11 14:10:08,034 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/f010afc6eba242e8adb7960c2f9304c5 2023-07-11 14:10:08,040 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/f010afc6eba242e8adb7960c2f9304c5 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f010afc6eba242e8adb7960c2f9304c5 2023-07-11 14:10:08,045 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f010afc6eba242e8adb7960c2f9304c5, entries=1, sequenceid=41, filesize=5.0 K 2023-07-11 14:10:08,046 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f398ea8794712f0784dc2726308bb40a in 836ms, sequenceid=41, compaction requested=true 2023-07-11 14:10:08,046 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:08,046 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:08,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:08,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:08,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 14:10:08,046 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 14:10:08,048 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,049 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:08,049 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,049 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:08,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 14:10:08,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1385eab5[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:08,051 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 14:10:08,051 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,052 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,052 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 14:10:08,052 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 14:10:08,052 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:08,053 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,053 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:08,054 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,054 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 14:10:08,054 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:08,054 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 14:10:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:08,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 14:10:08,067 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 14:10:08,067 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:08,067 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:08,067 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,067 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:08,069 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,069 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:08,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,069 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:08,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:08,070 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,071 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,073 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:08,073 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:08,073 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:08,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 14:10:08,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:08,074 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:08,073 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,074 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,074 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:08,074 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,074 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,074 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,074 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:08,074 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:08,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:08,174 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:08,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:08,177 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:08,178 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:08,179 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:08,180 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085208180 2023-07-11 14:10:08,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:08,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:10:08,182 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-11 14:10:08,182 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:08,183 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x2a757cbe to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:08,187 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a3d19c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:08,187 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,044 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032b43d5f736b3488f977d87ca1cb17df2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032b43d5f736b3488f977d87ca1cb17df2 2023-07-11 14:10:09,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:09,095 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:09,096 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:09,106 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:10:09,108 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:10:09,120 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73a5266129994777aecc0b19f836058b first=Optional[r3] last=Optional[r6] 2023-07-11 14:10:09,120 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73a5266129994777aecc0b19f836058b}] 2023-07-11 14:10:09,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73a5266129994777aecc0b19f836058b for inclusion in f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:09,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 14:10:09,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:10:09,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:09,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/73a5266129994777aecc0b19f836058b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ektv2onspamd5k66th9696c6va426bo9ta5mmqatpo2keuiq0qr15sl40aqr56k9/family1/73a5266129994777aecc0b19f836058b 2023-07-11 14:10:09,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ektv2onspamd5k66th9696c6va426bo9ta5mmqatpo2keuiq0qr15sl40aqr56k9/family1/73a5266129994777aecc0b19f836058b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_ 2023-07-11 14:10:09,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ektv2onspamd5k66th9696c6va426bo9ta5mmqatpo2keuiq0qr15sl40aqr56k9/family1/73a5266129994777aecc0b19f836058b into f398ea8794712f0784dc2726308bb40a/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_ - updating store file list. 2023-07-11 14:10:09,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_ into f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:09,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ektv2onspamd5k66th9696c6va426bo9ta5mmqatpo2keuiq0qr15sl40aqr56k9/family1/73a5266129994777aecc0b19f836058b into f398ea8794712f0784dc2726308bb40a/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_) 2023-07-11 14:10:09,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ektv2onspamd5k66th9696c6va426bo9ta5mmqatpo2keuiq0qr15sl40aqr56k9/family1/73a5266129994777aecc0b19f836058b 2023-07-11 14:10:09,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 14:10:09,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 14:10:09,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): f398ea8794712f0784dc2726308bb40a/family1 is initiating minor compaction 2023-07-11 14:10:09,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7bc00aca; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:09,142 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f398ea8794712f0784dc2726308bb40a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:09,142 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/02ecae2ad982423381cc09d8ca615fee, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/386ffac6377b4223877da27cc1a56c73, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/d0ba4a8cd7c447d487606a1574dc71cb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/5618d4cd4d3040c386c94a72ec9f5acd, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/7b443a2ae4a94dd89ff680174f7a19a3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/22f73f8cc8d64fbcbae03aa6e32075a4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f89f1bf7198a4cc7b0f6688399b53c9e, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/8508a8fdbf0a459bbcee914678cf457d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f010afc6eba242e8adb7960c2f9304c5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp, totalSize=50.4 K 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 02ecae2ad982423381cc09d8ca615fee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 386ffac6377b4223877da27cc1a56c73, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting d0ba4a8cd7c447d487606a1574dc71cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 5618d4cd4d3040c386c94a72ec9f5acd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 7b443a2ae4a94dd89ff680174f7a19a3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 22f73f8cc8d64fbcbae03aa6e32075a4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting f89f1bf7198a4cc7b0f6688399b53c9e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 8508a8fdbf0a459bbcee914678cf457d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting f010afc6eba242e8adb7960c2f9304c5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 14:10:09,142 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 14:10:09,143 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:09,144 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:09,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122875783bc4d26944b9b13663fef6146c48 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122875783bc4d26944b9b13663fef6146c48 2023-07-11 14:10:09,147 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123137e987febb0a4c9482e9aa8d44242b6b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123137e987febb0a4c9482e9aa8d44242b6b 2023-07-11 14:10:09,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010175f2e9872883461299cb0f3b3388888b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010175f2e9872883461299cb0f3b3388888b 2023-07-11 14:10:09,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103314dc2dc931e41ce8d1ad6ab7ed9ea3d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103314dc2dc931e41ce8d1ad6ab7ed9ea3d 2023-07-11 14:10:09,150 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-07-11 14:10:09,150 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,218 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): f398ea8794712f0784dc2726308bb40a#family1#compaction#61 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:09,665 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/3b268638a9ff48b6b40627939618127a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/3b268638a9ff48b6b40627939618127a 2023-07-11 14:10:09,673 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f398ea8794712f0784dc2726308bb40a/family1 of f398ea8794712f0784dc2726308bb40a into 3b268638a9ff48b6b40627939618127a(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:09,673 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:09,673 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1689084609142; duration=0sec 2023-07-11 14:10:09,673 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:09,690 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b64adf7eae08445d9ea39d41378a2f8f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205b64adf7eae08445d9ea39d41378a2f8f 2023-07-11 14:10:09,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:09,718 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a819f27a5f714dc2a203d535161cadda first=Optional[r00] last=Optional[r2] 2023-07-11 14:10:09,719 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a819f27a5f714dc2a203d535161cadda}] 2023-07-11 14:10:09,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a819f27a5f714dc2a203d535161cadda for inclusion in f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 14:10:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:10:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:09,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a819f27a5f714dc2a203d535161cadda to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v7i8csc6v80tp09k04j008bpp50rrh7hmgnvpea2p993mviroj02n4qp5mvcumm5/family1/a819f27a5f714dc2a203d535161cadda 2023-07-11 14:10:09,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v7i8csc6v80tp09k04j008bpp50rrh7hmgnvpea2p993mviroj02n4qp5mvcumm5/family1/a819f27a5f714dc2a203d535161cadda as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_ 2023-07-11 14:10:09,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v7i8csc6v80tp09k04j008bpp50rrh7hmgnvpea2p993mviroj02n4qp5mvcumm5/family1/a819f27a5f714dc2a203d535161cadda into f398ea8794712f0784dc2726308bb40a/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_ - updating store file list. 2023-07-11 14:10:09,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_ into f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:09,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v7i8csc6v80tp09k04j008bpp50rrh7hmgnvpea2p993mviroj02n4qp5mvcumm5/family1/a819f27a5f714dc2a203d535161cadda into f398ea8794712f0784dc2726308bb40a/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_) 2023-07-11 14:10:09,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v7i8csc6v80tp09k04j008bpp50rrh7hmgnvpea2p993mviroj02n4qp5mvcumm5/family1/a819f27a5f714dc2a203d535161cadda 2023-07-11 14:10:09,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 14:10:09,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 14:10:09,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): f398ea8794712f0784dc2726308bb40a/family1 is initiating minor compaction (all files) 2023-07-11 14:10:09,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5befa2b3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:09,739 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f398ea8794712f0784dc2726308bb40a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:09,739 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/c19360afa2714851929506e61f4394af, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/3b268638a9ff48b6b40627939618127a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp, totalSize=390.1 K 2023-07-11 14:10:09,740 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting c19360afa2714851929506e61f4394af, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878818110 2023-07-11 14:10:09,741 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 3b268638a9ff48b6b40627939618127a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621218110 2023-07-11 14:10:09,741 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting bfef7015996b44a7b4019c12a022ba37_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878818110 2023-07-11 14:10:09,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:09,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/02ecae2ad982423381cc09d8ca615fee, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/386ffac6377b4223877da27cc1a56c73, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/d0ba4a8cd7c447d487606a1574dc71cb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/5618d4cd4d3040c386c94a72ec9f5acd, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/7b443a2ae4a94dd89ff680174f7a19a3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/22f73f8cc8d64fbcbae03aa6e32075a4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f89f1bf7198a4cc7b0f6688399b53c9e, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/8508a8fdbf0a459bbcee914678cf457d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f010afc6eba242e8adb7960c2f9304c5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_] to archive 2023-07-11 14:10:09,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:09,745 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:09,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/02ecae2ad982423381cc09d8ca615fee to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/02ecae2ad982423381cc09d8ca615fee 2023-07-11 14:10:09,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/386ffac6377b4223877da27cc1a56c73 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/386ffac6377b4223877da27cc1a56c73 2023-07-11 14:10:09,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113055dcfdf1ac46494e8bf7c6d3f7144249 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113055dcfdf1ac46494e8bf7c6d3f7144249 2023-07-11 14:10:09,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/d0ba4a8cd7c447d487606a1574dc71cb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/d0ba4a8cd7c447d487606a1574dc71cb 2023-07-11 14:10:09,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120129a2c90e24ea465982de0a5ba43f3f7f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120129a2c90e24ea465982de0a5ba43f3f7f 2023-07-11 14:10:09,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/5618d4cd4d3040c386c94a72ec9f5acd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/5618d4cd4d3040c386c94a72ec9f5acd 2023-07-11 14:10:09,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dfc62df4b6814a7797a7166d60bec12b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dfc62df4b6814a7797a7166d60bec12b 2023-07-11 14:10:09,760 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-07-11 14:10:09,760 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 14:10:09,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/7b443a2ae4a94dd89ff680174f7a19a3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/7b443a2ae4a94dd89ff680174f7a19a3 2023-07-11 14:10:09,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:09,761 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:09,761 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:09,767 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:09,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/22f73f8cc8d64fbcbae03aa6e32075a4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/22f73f8cc8d64fbcbae03aa6e32075a4 2023-07-11 14:10:09,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f89f1bf7198a4cc7b0f6688399b53c9e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f89f1bf7198a4cc7b0f6688399b53c9e 2023-07-11 14:10:09,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.5900 sec 2023-07-11 14:10:09,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/8508a8fdbf0a459bbcee914678cf457d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/8508a8fdbf0a459bbcee914678cf457d 2023-07-11 14:10:09,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f010afc6eba242e8adb7960c2f9304c5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/f010afc6eba242e8adb7960c2f9304c5 2023-07-11 14:10:09,775 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): f398ea8794712f0784dc2726308bb40a#family1#compaction#62 average throughput is 8.60 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:09,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/2cb7d516b3fe4a119fce2bcdba60b477_SeqId_44_ 2023-07-11 14:10:09,827 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/.tmp/family1/b1fe89dc713a48029a9a5a70bc5aaa8c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/b1fe89dc713a48029a9a5a70bc5aaa8c 2023-07-11 14:10:09,834 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f398ea8794712f0784dc2726308bb40a/family1 of f398ea8794712f0784dc2726308bb40a into b1fe89dc713a48029a9a5a70bc5aaa8c(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:09,834 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:09,834 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1689084609739; duration=0sec 2023-07-11 14:10:09,834 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:09,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/c19360afa2714851929506e61f4394af, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/3b268638a9ff48b6b40627939618127a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_] to archive 2023-07-11 14:10:09,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:09,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/c19360afa2714851929506e61f4394af to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/c19360afa2714851929506e61f4394af 2023-07-11 14:10:09,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/3b268638a9ff48b6b40627939618127a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/3b268638a9ff48b6b40627939618127a 2023-07-11 14:10:09,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/bfef7015996b44a7b4019c12a022ba37_SeqId_47_ 2023-07-11 14:10:09,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 14:10:09,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:10,279 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:10,280 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:10,281 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:10,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-07-11 14:10:10,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE}] 2023-07-11 14:10:10,286 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE 2023-07-11 14:10:10,287 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:10,287 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084610287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084610287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084610287"}]},"ts":"1689084610287"} 2023-07-11 14:10:10,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:10,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f398ea8794712f0784dc2726308bb40a, disabling compactions & flushes 2023-07-11 14:10:10,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:10,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:10,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. after waiting 0 ms 2023-07-11 14:10:10,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:10,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-11 14:10:10,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:10,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:10,447 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: f398ea8794712f0784dc2726308bb40a to self. 2023-07-11 14:10:10,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=CLOSED 2023-07-11 14:10:10,449 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084610449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084610449"}]},"ts":"1689084610449"} 2023-07-11 14:10:10,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-07-11 14:10:10,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 161 msec 2023-07-11 14:10:10,452 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=true 2023-07-11 14:10:10,603 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:10,603 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084610603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084610603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084610603"}]},"ts":"1689084610603"} 2023-07-11 14:10:10,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:10,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:10,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f398ea8794712f0784dc2726308bb40a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:10:10,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:10,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,761 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,762 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:10,762 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:10,763 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f398ea8794712f0784dc2726308bb40a columnFamilyName family1 2023-07-11 14:10:10,768 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/b1fe89dc713a48029a9a5a70bc5aaa8c 2023-07-11 14:10:10,769 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(310): Store=f398ea8794712f0784dc2726308bb40a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:10,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:10,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f398ea8794712f0784dc2726308bb40a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69592116, jitterRate=0.03700333833694458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:10:10,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:10,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., pid=47, masterSystemTime=1689084610756 2023-07-11 14:10:10,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:10,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:10,778 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:10,778 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084610778"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084610778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084610778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084610778"}]},"ts":"1689084610778"} 2023-07-11 14:10:10,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-07-11 14:10:10,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 175 msec 2023-07-11 14:10:10,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-11 14:10:10,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE in 496 msec 2023-07-11 14:10:10,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-07-11 14:10:10,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 503 msec 2023-07-11 14:10:10,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 920 msec 2023-07-11 14:10:10,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-07-11 14:10:10,792 INFO [Listener at localhost/44533] compactions.TestMobCompactor(278): alter status finished 2023-07-11 14:10:10,792 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:10,794 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:10,795 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:10,795 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:10,795 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085210795 2023-07-11 14:10:10,798 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:10:10,798 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-11 14:10:10,798 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:10,799 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x7b4aaea9 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:10,811 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@94b7326, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:10,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:10,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:10,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:10,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:10,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:11,645 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c23b88825fc14b2d8a8af12b54f910a8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c23b88825fc14b2d8a8af12b54f910a8 2023-07-11 14:10:11,646 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:11,665 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:11,666 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:11,673 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:10:11,674 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:10:11,682 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5456647f0b6a4ad1928da81773b6b1b3 first=Optional[r05] last=Optional[r8] 2023-07-11 14:10:11,682 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=51 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5456647f0b6a4ad1928da81773b6b1b3}] 2023-07-11 14:10:11,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5456647f0b6a4ad1928da81773b6b1b3 for inclusion in f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:11,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-11 14:10:11,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:10:11,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:11,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5456647f0b6a4ad1928da81773b6b1b3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6k48t3puf80pnerb3o77v19q50eanhpht7sh97s6np6fadavhd7cdfafdkmlpi1a/family1/5456647f0b6a4ad1928da81773b6b1b3 2023-07-11 14:10:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6k48t3puf80pnerb3o77v19q50eanhpht7sh97s6np6fadavhd7cdfafdkmlpi1a/family1/5456647f0b6a4ad1928da81773b6b1b3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/a9b68800c1bd4617b88a98f6a19a2b28_SeqId_53_ 2023-07-11 14:10:11,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6k48t3puf80pnerb3o77v19q50eanhpht7sh97s6np6fadavhd7cdfafdkmlpi1a/family1/5456647f0b6a4ad1928da81773b6b1b3 into f398ea8794712f0784dc2726308bb40a/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/a9b68800c1bd4617b88a98f6a19a2b28_SeqId_53_ - updating store file list. 2023-07-11 14:10:11,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/a9b68800c1bd4617b88a98f6a19a2b28_SeqId_53_ into f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:11,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6k48t3puf80pnerb3o77v19q50eanhpht7sh97s6np6fadavhd7cdfafdkmlpi1a/family1/5456647f0b6a4ad1928da81773b6b1b3 into f398ea8794712f0784dc2726308bb40a/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/a9b68800c1bd4617b88a98f6a19a2b28_SeqId_53_) 2023-07-11 14:10:11,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__6k48t3puf80pnerb3o77v19q50eanhpht7sh97s6np6fadavhd7cdfafdkmlpi1a/family1/5456647f0b6a4ad1928da81773b6b1b3 2023-07-11 14:10:11,700 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:11,701 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:11,702 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511201d516b34a3c84535837c55ee750e8f92 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511201d516b34a3c84535837c55ee750e8f92 2023-07-11 14:10:11,703 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112850794016f36246debc2d45d2965595b5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112850794016f36246debc2d45d2965595b5 2023-07-11 14:10:11,703 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-07-11 14:10:11,703 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 14:10:11,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:11,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:11,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:11,704 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:11,704 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:11,705 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:11,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 912 msec 2023-07-11 14:10:11,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 14:10:11,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:12,163 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-07-11 14:10:12,164 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:12,164 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-07-11 14:10:12,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-07-11 14:10:12,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE}] 2023-07-11 14:10:12,170 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE 2023-07-11 14:10:12,170 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:12,170 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084612170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084612170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084612170"}]},"ts":"1689084612170"} 2023-07-11 14:10:12,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:12,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f398ea8794712f0784dc2726308bb40a, disabling compactions & flushes 2023-07-11 14:10:12,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. after waiting 0 ms 2023-07-11 14:10:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:12,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-07-11 14:10:12,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:12,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:12,329 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: f398ea8794712f0784dc2726308bb40a to self. 2023-07-11 14:10:12,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,331 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=CLOSED 2023-07-11 14:10:12,331 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084612331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084612331"}]},"ts":"1689084612331"} 2023-07-11 14:10:12,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-11 14:10:12,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 161 msec 2023-07-11 14:10:12,335 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=true 2023-07-11 14:10:12,485 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:12,485 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084612485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084612485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084612485"}]},"ts":"1689084612485"} 2023-07-11 14:10:12,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:12,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:12,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f398ea8794712f0784dc2726308bb40a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:10:12,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:12,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,644 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,645 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:12,645 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1 2023-07-11 14:10:12,645 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f398ea8794712f0784dc2726308bb40a columnFamilyName family1 2023-07-11 14:10:12,651 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/a9b68800c1bd4617b88a98f6a19a2b28_SeqId_53_ 2023-07-11 14:10:12,655 DEBUG [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/family1/b1fe89dc713a48029a9a5a70bc5aaa8c 2023-07-11 14:10:12,655 INFO [StoreOpener-f398ea8794712f0784dc2726308bb40a-1] regionserver.HStore(310): Store=f398ea8794712f0784dc2726308bb40a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:12,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:10:12,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f398ea8794712f0784dc2726308bb40a; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67241109, jitterRate=0.0019706040620803833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:10:12,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:10:12,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a., pid=53, masterSystemTime=1689084612639 2023-07-11 14:10:12,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:12,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:10:12,663 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f398ea8794712f0784dc2726308bb40a, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:12,664 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689084612663"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084612663"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084612663"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084612663"}]},"ts":"1689084612663"} 2023-07-11 14:10:12,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-11 14:10:12,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure f398ea8794712f0784dc2726308bb40a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 178 msec 2023-07-11 14:10:12,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-07-11 14:10:12,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f398ea8794712f0784dc2726308bb40a, REOPEN/MOVE in 498 msec 2023-07-11 14:10:12,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-07-11 14:10:12,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 502 msec 2023-07-11 14:10:12,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 924 msec 2023-07-11 14:10:12,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-11 14:10:12,678 INFO [Listener at localhost/44533] compactions.TestMobCompactor(278): alter status finished 2023-07-11 14:10:12,680 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 14:10:12,682 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:12,683 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:12,683 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085212683 2023-07-11 14:10:12,683 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:12,684 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:10:12,685 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-11 14:10:12,685 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:12,685 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x097eb855 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:12,696 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b7e281f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:12,696 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 14:10:12,697 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 14:10:12,697 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:12,698 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 14:10:12,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 17 msec 2023-07-11 14:10:12,748 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=256 (was 261), OpenFileDescriptor=634 (was 617) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=645 (was 604) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=637 (was 907) 2023-07-11 14:10:12,760 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=256, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=645, ProcessCount=181, AvailableMemoryMB=636 2023-07-11 14:10:12,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 14:10:12,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:12,764 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:10:12,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-07-11 14:10:12,764 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:10:12,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 14:10:12,766 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:12,766 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 empty. 2023-07-11 14:10:12,767 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:12,767 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-07-11 14:10:12,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 14:10:13,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 14:10:13,175 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:13,176 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => ede8be49db937c3a62b0dc3899496428, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:13,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 14:10:13,582 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:13,583 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing ede8be49db937c3a62b0dc3899496428, disabling compactions & flushes 2023-07-11 14:10:13,583 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:13,583 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:13,583 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. after waiting 0 ms 2023-07-11 14:10:13,583 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:13,583 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:13,583 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:13,586 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:10:13,587 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084613587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084613587"}]},"ts":"1689084613587"} 2023-07-11 14:10:13,592 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:10:13,593 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:10:13,593 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084613593"}]},"ts":"1689084613593"} 2023-07-11 14:10:13,596 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-07-11 14:10:13,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, ASSIGN}] 2023-07-11 14:10:13,601 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, ASSIGN 2023-07-11 14:10:13,605 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:13,756 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:13,756 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084613756"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084613756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084613756"}]},"ts":"1689084613756"} 2023-07-11 14:10:13,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:13,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 14:10:13,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:13,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ede8be49db937c3a62b0dc3899496428, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:10:13,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:13,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:13,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:13,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:13,919 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:13,921 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:13,921 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:13,921 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede8be49db937c3a62b0dc3899496428 columnFamilyName family1 2023-07-11 14:10:13,923 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(310): Store=ede8be49db937c3a62b0dc3899496428/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:13,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:13,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:13,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:13,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:13,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ede8be49db937c3a62b0dc3899496428; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61459471, jitterRate=-0.08418251574039459}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:10:13,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:13,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., pid=57, masterSystemTime=1689084613915 2023-07-11 14:10:13,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:13,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:13,939 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:13,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084613939"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084613939"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084613939"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084613939"}]},"ts":"1689084613939"} 2023-07-11 14:10:13,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-07-11 14:10:13,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537 in 183 msec 2023-07-11 14:10:13,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-07-11 14:10:13,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, ASSIGN in 344 msec 2023-07-11 14:10:13,954 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:10:13,955 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084613954"}]},"ts":"1689084613954"} 2023-07-11 14:10:13,956 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-07-11 14:10:13,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:10:13,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1970 sec 2023-07-11 14:10:14,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 14:10:14,871 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-07-11 14:10:14,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:14,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,926 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:14,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:14,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:14,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:14,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,928 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:14,928 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:14,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:14,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:14,928 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:14,928 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:14,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:14,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,929 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:14,934 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:14,934 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:14,934 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:14,937 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:14,937 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:14,938 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:14,938 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:14,939 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 14:10:14,970 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c60e65353f11454fb72ec9d2370a9fdd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c60e65353f11454fb72ec9d2370a9fdd 2023-07-11 14:10:14,985 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/25746deaf3d64a768d0b53baffd697e4 2023-07-11 14:10:14,991 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/25746deaf3d64a768d0b53baffd697e4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/25746deaf3d64a768d0b53baffd697e4 2023-07-11 14:10:14,997 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/25746deaf3d64a768d0b53baffd697e4, entries=1000, sequenceid=5, filesize=190.5 K 2023-07-11 14:10:14,998 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 59ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:14,998 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:14,999 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:14,999 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:14,999 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:14,999 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:14,999 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:14,999 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:14,999 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:15,001 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,001 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,001 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,001 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:15,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f17b573[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:15,004 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:15,004 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,006 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,006 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:15,006 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,006 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:15,006 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:15,006 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:15,010 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:15,010 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:15,010 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:15,012 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:15,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:15,024 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:15,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:15,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:15,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,024 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:15,028 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,028 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,028 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:15,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,028 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,030 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,037 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:15,037 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:15,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:15,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:15,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:15,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:15,038 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:15,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:15,038 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,039 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,039 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,039 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,039 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,039 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,038 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:15,039 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:15,039 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:15,139 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:15,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:15,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:15,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:15,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,147 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:15,147 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:15,147 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:15,147 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:15,147 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,147 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,149 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,149 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:15,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:15,149 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,149 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,150 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,150 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:15,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,151 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:15,151 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:15,151 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:15,152 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:15,152 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:15,152 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:15,152 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:15,152 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 14:10:15,568 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283a6d28c6e9b8451cb4c5b12357e41a4f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283a6d28c6e9b8451cb4c5b12357e41a4f 2023-07-11 14:10:15,581 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/f31b58cd52dd47a89e2bfc47be5e1302 2023-07-11 14:10:15,588 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/f31b58cd52dd47a89e2bfc47be5e1302 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/f31b58cd52dd47a89e2bfc47be5e1302 2023-07-11 14:10:15,592 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/f31b58cd52dd47a89e2bfc47be5e1302, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 14:10:15,593 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 441ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:15,593 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:15,593 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:15,593 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:15,593 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:15,594 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,594 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:15,594 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:15,596 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,596 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,597 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,597 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:15,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:15,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b821192[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:15,599 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:15,599 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,602 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,602 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:15,602 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:15,602 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:15,603 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,603 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:15,604 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:15,604 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:15,604 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:15,604 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:15,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:15,607 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:15,608 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:15,608 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:15,608 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,608 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:15,610 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,610 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:15,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,610 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,611 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,613 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,616 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:15,616 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:15,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:15,616 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,616 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,617 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:15,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:15,617 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,617 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:15,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:15,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:15,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 14:10:15,617 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,617 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,617 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,617 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:15,617 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:15,718 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:15,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:15,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:15,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:15,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,736 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:15,736 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:15,736 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:15,736 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:15,737 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,737 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,741 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:15,741 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:15,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:15,741 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,741 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:15,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:15,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,742 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:15,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,746 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:15,746 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:15,746 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:15,749 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:15,749 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:15,749 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:15,749 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:15,750 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:15,793 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201075c536814bd4da3b652eef1bd7588b7 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201075c536814bd4da3b652eef1bd7588b7 2023-07-11 14:10:15,822 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/9e22baa08c094be8914c7a9b58b202c5 2023-07-11 14:10:15,830 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/9e22baa08c094be8914c7a9b58b202c5 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/9e22baa08c094be8914c7a9b58b202c5 2023-07-11 14:10:15,837 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/9e22baa08c094be8914c7a9b58b202c5, entries=1, sequenceid=13, filesize=5.0 K 2023-07-11 14:10:15,838 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 87ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:15,838 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:15,838 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:15,838 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:15,838 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:15,838 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,838 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:15,838 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:15,840 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,840 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,840 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,840 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:15,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bbcc9f5[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:15,842 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:15,842 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,844 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,844 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:15,844 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:15,844 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:15,844 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,844 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:15,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:15,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:15,846 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,846 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:15,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:15,850 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:15,850 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:15,850 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:15,850 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,850 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:15,853 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,853 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:15,853 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:15,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:15,854 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,856 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:15,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:15,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 14:10:15,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:15,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:15,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:15,860 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:15,861 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:15,861 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:15,860 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,861 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,861 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,861 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:15,948 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:10:15,961 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:15,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:15,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:15,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:15,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,992 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:15,992 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:15,992 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:15,992 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:15,993 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,993 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,994 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:15,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:15,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:15,994 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,995 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:15,995 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:15,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:15,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,996 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:15,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:15,997 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:15,998 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:15,998 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:15,998 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:15,998 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:15,998 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:15,998 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:15,998 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:16,077 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e354f23d10a54e46b11454ac63466c33 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e354f23d10a54e46b11454ac63466c33 2023-07-11 14:10:16,093 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/873a595468e046cbbd73999d034e6b5e 2023-07-11 14:10:16,099 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/873a595468e046cbbd73999d034e6b5e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/873a595468e046cbbd73999d034e6b5e 2023-07-11 14:10:16,106 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/873a595468e046cbbd73999d034e6b5e, entries=1, sequenceid=17, filesize=5.0 K 2023-07-11 14:10:16,107 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 109ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:16,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:16,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:16,107 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:16,107 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:16,107 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,108 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:16,108 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:16,109 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,109 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:16,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:16,110 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,110 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:16,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:16,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:16,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:16,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37505a75[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:16,112 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:16,112 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,114 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,114 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,115 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:16,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,115 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:16,115 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:16,115 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:16,120 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:16,120 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:16,120 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:16,121 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:16,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:16,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:16,129 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:16,129 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:16,129 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:16,129 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,129 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:16,132 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:16,132 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,133 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:16,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,135 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,138 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:16,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,143 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:16,143 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:16,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:16,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:16,143 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,144 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:16,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:16,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:16,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:16,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:16,144 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:16,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 14:10:16,245 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:16,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:16,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:16,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,256 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:16,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:16,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:16,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:16,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,257 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,259 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:16,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:16,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:16,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:16,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:16,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,261 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:16,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,262 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:16,262 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:16,262 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:16,266 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:16,266 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:16,266 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:16,266 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:16,266 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:16,294 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e794e870bf9f41efbdafe9753b5893cc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e794e870bf9f41efbdafe9753b5893cc 2023-07-11 14:10:16,712 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/707e2b6699b748c18f979ba9b9fae495 2023-07-11 14:10:16,721 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/707e2b6699b748c18f979ba9b9fae495 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/707e2b6699b748c18f979ba9b9fae495 2023-07-11 14:10:16,727 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/707e2b6699b748c18f979ba9b9fae495, entries=1, sequenceid=21, filesize=5.0 K 2023-07-11 14:10:16,728 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 462ms, sequenceid=21, compaction requested=true 2023-07-11 14:10:16,728 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:16,728 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:16,728 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:16,728 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:16,728 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,728 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:16,728 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:16,731 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,732 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:16,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:16,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:16,733 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,733 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:16,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:16,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:16,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@653ecdc1[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:16,740 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:16,740 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,741 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,741 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:16,741 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:16,741 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:16,742 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,742 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:16,743 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,743 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:16,743 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:16,743 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:16,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:16,746 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:16,747 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:16,747 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:16,747 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,747 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:16,750 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,750 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:16,750 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:16,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:16,752 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:16,754 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,758 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:16,758 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:16,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:16,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:16,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 14:10:16,759 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:16,759 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:16,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:16,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:16,859 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:16,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:16,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:16,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:16,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,873 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:16,873 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:16,873 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:16,873 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:16,874 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,874 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,875 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:16,875 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:16,876 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:16,876 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:16,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,877 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,881 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:16,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:16,882 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:16,882 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:16,882 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:16,889 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:16,889 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:16,889 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:16,890 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:16,890 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:17,373 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231341f4907096b42e886779fd4a224abb1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231341f4907096b42e886779fd4a224abb1 2023-07-11 14:10:17,402 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/faafda7ae03642b5af1902cb1afd9dda 2023-07-11 14:10:17,408 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/faafda7ae03642b5af1902cb1afd9dda as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/faafda7ae03642b5af1902cb1afd9dda 2023-07-11 14:10:17,416 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/faafda7ae03642b5af1902cb1afd9dda, entries=1, sequenceid=25, filesize=5.0 K 2023-07-11 14:10:17,417 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 527ms, sequenceid=25, compaction requested=true 2023-07-11 14:10:17,417 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:17,417 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:17,420 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:17,420 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:17,420 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,420 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:17,420 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:17,422 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,422 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:17,423 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,423 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:17,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:17,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2efb5e75[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:17,425 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:17,425 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,427 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,427 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:17,427 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:17,427 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:17,427 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,428 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:17,430 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:17,430 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:17,430 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:17,430 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:17,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:17,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:17,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:17,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:17,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:17,434 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:17,434 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:17,434 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:17,434 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,434 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:17,436 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,436 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,436 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:17,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:17,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:17,437 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:17,439 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,447 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,447 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:17,447 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:17,447 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:17,447 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:17,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:17,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:17,447 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,448 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,448 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,448 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,448 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,448 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:17,448 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:17,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:17,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 14:10:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:17,548 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:17,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:17,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:17,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:17,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,556 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:17,557 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:17,557 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:17,557 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:17,557 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,557 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,566 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:17,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:17,566 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,567 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:17,567 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:17,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,568 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,568 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:17,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:17,568 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:17,568 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:17,568 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:17,581 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:17,581 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:17,584 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:17,584 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:17,584 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:18,043 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101354c6be6ab4f4552ba9a75290f56b18c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101354c6be6ab4f4552ba9a75290f56b18c 2023-07-11 14:10:18,081 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/8e23ed4790294d9ba127028b8e3b1e30 2023-07-11 14:10:18,089 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/8e23ed4790294d9ba127028b8e3b1e30 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8e23ed4790294d9ba127028b8e3b1e30 2023-07-11 14:10:18,095 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8e23ed4790294d9ba127028b8e3b1e30, entries=1, sequenceid=29, filesize=5.0 K 2023-07-11 14:10:18,102 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 518ms, sequenceid=29, compaction requested=true 2023-07-11 14:10:18,102 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:18,102 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:18,102 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:18,102 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:18,102 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,102 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:18,103 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:18,104 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,104 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,105 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,105 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:18,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:18,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e5c93e[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:18,107 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:18,107 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,109 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,109 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:18,109 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:18,109 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:18,110 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,110 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:18,113 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,113 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,113 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:18,113 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:18,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:18,118 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:18,118 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:18,118 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:18,118 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,118 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:18,120 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,120 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,121 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:18,122 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,124 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,127 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,127 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,127 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,127 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,127 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,127 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:18,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 14:10:18,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:18,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:18,128 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,127 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:18,128 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:18,128 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:18,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:18,129 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:18,130 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:18,230 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:18,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:18,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:18,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:18,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,240 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:18,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:18,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:18,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:18,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,240 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:18,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:18,245 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,246 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,246 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:18,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:18,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:18,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,265 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:18,265 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:18,265 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:18,267 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:18,267 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:18,268 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:18,268 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:18,268 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:18,302 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103133dc6b4c6634c278368661e75626bdf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103133dc6b4c6634c278368661e75626bdf 2023-07-11 14:10:18,310 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/5e44ebe25ff44968a9d5ef2d50a7685d 2023-07-11 14:10:18,315 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/5e44ebe25ff44968a9d5ef2d50a7685d as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/5e44ebe25ff44968a9d5ef2d50a7685d 2023-07-11 14:10:18,319 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/5e44ebe25ff44968a9d5ef2d50a7685d, entries=1, sequenceid=33, filesize=5.0 K 2023-07-11 14:10:18,320 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 52ms, sequenceid=33, compaction requested=true 2023-07-11 14:10:18,320 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:18,320 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:18,320 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:18,320 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:18,320 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,320 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:18,320 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:18,321 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,322 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,322 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:18,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d3a0c5[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:18,323 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:18,323 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,324 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,325 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:18,325 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:18,325 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:18,325 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,325 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:18,326 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:18,326 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,326 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,326 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:18,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:18,328 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:18,328 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:18,328 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:18,328 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,328 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:18,331 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,331 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,331 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,331 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,332 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:18,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:18,335 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:18,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:18,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:18,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:18,335 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,336 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,436 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:18,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:18,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:18,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:18,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,454 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:18,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:18,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:18,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:18,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,456 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:18,456 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:18,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:18,456 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,456 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:18,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:18,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,458 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,458 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:18,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,458 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:18,458 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:18,458 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:18,459 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:18,459 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:18,460 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:18,460 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:18,460 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:18,519 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907694c692529954e2bafcabcf384347b74 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907694c692529954e2bafcabcf384347b74 2023-07-11 14:10:18,929 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/8f2ee0b3a45b44bb821a97086bffdca5 2023-07-11 14:10:18,939 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/8f2ee0b3a45b44bb821a97086bffdca5 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8f2ee0b3a45b44bb821a97086bffdca5 2023-07-11 14:10:18,945 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8f2ee0b3a45b44bb821a97086bffdca5, entries=1, sequenceid=37, filesize=5.0 K 2023-07-11 14:10:18,946 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 486ms, sequenceid=37, compaction requested=true 2023-07-11 14:10:18,946 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:18,947 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:18,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:18,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:18,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:18,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:18,949 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,949 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,950 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,950 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:18,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65903b1b[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:18,953 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:18,953 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,954 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:18,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:18,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:18,955 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,955 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:18,956 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:18,956 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:18,956 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,956 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:18,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:18,958 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:18,958 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:18,958 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:18,959 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,959 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:18,960 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,960 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:18,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,960 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:18,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:18,961 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,964 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:18,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:18,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:18,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:18,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:18,969 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:18,969 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:18,970 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:18,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:19,070 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:19,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:19,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:19,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:19,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,079 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:19,079 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:19,079 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 14:10:19,079 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 14:10:19,079 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,079 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,081 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:19,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:19,081 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,081 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,081 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:19,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,082 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,089 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 14:10:19,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,090 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 14:10:19,090 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:19,090 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 14:10:19,090 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:10:19,090 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:19,090 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:19,090 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. started... 2023-07-11 14:10:19,090 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ede8be49db937c3a62b0dc3899496428 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:10:19,111 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204681d9e23b5649e393bab45bde16cdcc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204681d9e23b5649e393bab45bde16cdcc 2023-07-11 14:10:19,519 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/c493ed362d4e4a4e86e215a809b884d1 2023-07-11 14:10:19,525 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/c493ed362d4e4a4e86e215a809b884d1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/c493ed362d4e4a4e86e215a809b884d1 2023-07-11 14:10:19,529 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/c493ed362d4e4a4e86e215a809b884d1, entries=1, sequenceid=41, filesize=5.0 K 2023-07-11 14:10:19,530 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ede8be49db937c3a62b0dc3899496428 in 440ms, sequenceid=41, compaction requested=true 2023-07-11 14:10:19,530 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:19,530 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:19,530 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:10:19,530 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:10:19,530 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,530 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 14:10:19,531 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 14:10:19,532 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,532 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:19,532 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,533 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:19,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 14:10:19,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@116cc92a[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:19,534 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 14:10:19,534 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,535 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 14:10:19,535 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 14:10:19,535 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:19,535 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,535 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:19,537 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 14:10:19,537 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,537 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:19,537 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 14:10:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:19,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 14:10:19,539 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 14:10:19,539 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:19,539 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:19,539 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,540 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:19,541 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,541 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,541 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:19,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:19,542 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,543 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,545 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,545 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:19,545 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,545 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:19,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:19,545 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:19,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 14:10:19,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:19,545 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,546 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:19,546 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,546 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,546 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,546 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:19,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:19,546 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:19,646 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:19,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:19,648 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:19,649 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:19,650 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:19,651 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:19,651 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085219651 2023-07-11 14:10:19,653 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:10:19,654 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-11 14:10:19,654 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:19,654 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x3e48a118 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:19,658 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@942ec96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:19,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,103 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032f999140744f4a3d8cb4ba41da051779 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601032f999140744f4a3d8cb4ba41da051779 2023-07-11 14:10:20,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:20,117 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:20,118 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:20,125 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:10:20,126 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:10:20,134 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5215184a3e6946b982e6270c1ebfe073 first=Optional[r3] last=Optional[r6] 2023-07-11 14:10:20,135 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5215184a3e6946b982e6270c1ebfe073}] 2023-07-11 14:10:20,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5215184a3e6946b982e6270c1ebfe073 for inclusion in ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:20,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 14:10:20,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:10:20,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:20,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5215184a3e6946b982e6270c1ebfe073 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fsvcctfl1mnqiqk11r0dv7lppuj6mgiqe4l9heem2jc91dt0q6bgmq4n5c44ja3g/family1/5215184a3e6946b982e6270c1ebfe073 2023-07-11 14:10:20,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fsvcctfl1mnqiqk11r0dv7lppuj6mgiqe4l9heem2jc91dt0q6bgmq4n5c44ja3g/family1/5215184a3e6946b982e6270c1ebfe073 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_ 2023-07-11 14:10:20,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fsvcctfl1mnqiqk11r0dv7lppuj6mgiqe4l9heem2jc91dt0q6bgmq4n5c44ja3g/family1/5215184a3e6946b982e6270c1ebfe073 into ede8be49db937c3a62b0dc3899496428/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_ - updating store file list. 2023-07-11 14:10:20,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_ into ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:20,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fsvcctfl1mnqiqk11r0dv7lppuj6mgiqe4l9heem2jc91dt0q6bgmq4n5c44ja3g/family1/5215184a3e6946b982e6270c1ebfe073 into ede8be49db937c3a62b0dc3899496428/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_) 2023-07-11 14:10:20,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fsvcctfl1mnqiqk11r0dv7lppuj6mgiqe4l9heem2jc91dt0q6bgmq4n5c44ja3g/family1/5215184a3e6946b982e6270c1ebfe073 2023-07-11 14:10:20,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 14:10:20,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 14:10:20,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): ede8be49db937c3a62b0dc3899496428/family1 is initiating minor compaction 2023-07-11 14:10:20,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1efcbfb3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:20,154 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ede8be49db937c3a62b0dc3899496428/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:20,154 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/f31b58cd52dd47a89e2bfc47be5e1302, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/9e22baa08c094be8914c7a9b58b202c5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/873a595468e046cbbd73999d034e6b5e, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/707e2b6699b748c18f979ba9b9fae495, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/faafda7ae03642b5af1902cb1afd9dda, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8e23ed4790294d9ba127028b8e3b1e30, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/5e44ebe25ff44968a9d5ef2d50a7685d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8f2ee0b3a45b44bb821a97086bffdca5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/c493ed362d4e4a4e86e215a809b884d1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp, totalSize=50.3 K 2023-07-11 14:10:20,154 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting f31b58cd52dd47a89e2bfc47be5e1302, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:10:20,154 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 9e22baa08c094be8914c7a9b58b202c5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:10:20,154 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 873a595468e046cbbd73999d034e6b5e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 14:10:20,155 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 707e2b6699b748c18f979ba9b9fae495, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 14:10:20,155 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting faafda7ae03642b5af1902cb1afd9dda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 14:10:20,155 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 8e23ed4790294d9ba127028b8e3b1e30, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 14:10:20,155 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 5e44ebe25ff44968a9d5ef2d50a7685d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 14:10:20,155 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 8f2ee0b3a45b44bb821a97086bffdca5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 14:10:20,155 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting c493ed362d4e4a4e86e215a809b884d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 14:10:20,155 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 47b92e8998f84258aff8ef22045bb00c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 14:10:20,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:20,157 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:20,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e794e870bf9f41efbdafe9753b5893cc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e794e870bf9f41efbdafe9753b5893cc 2023-07-11 14:10:20,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231341f4907096b42e886779fd4a224abb1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231341f4907096b42e886779fd4a224abb1 2023-07-11 14:10:20,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101354c6be6ab4f4552ba9a75290f56b18c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101354c6be6ab4f4552ba9a75290f56b18c 2023-07-11 14:10:20,163 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103133dc6b4c6634c278368661e75626bdf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103133dc6b4c6634c278368661e75626bdf 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-07-11 14:10:20,164 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,222 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): ede8be49db937c3a62b0dc3899496428#family1#compaction#73 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:20,276 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ff1d6086ff4742039202e18cede150ce to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ff1d6086ff4742039202e18cede150ce 2023-07-11 14:10:20,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:20,301 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f first=Optional[r00] last=Optional[r2] 2023-07-11 14:10:20,301 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f}] 2023-07-11 14:10:20,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f for inclusion in ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:20,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 14:10:20,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:10:20,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:20,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1fpepiuttd55h2h469dqhg6iruanrivose2hf5bbfre6kgccd1dfp9q2f3v38cvg/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f 2023-07-11 14:10:20,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1fpepiuttd55h2h469dqhg6iruanrivose2hf5bbfre6kgccd1dfp9q2f3v38cvg/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_ 2023-07-11 14:10:20,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1fpepiuttd55h2h469dqhg6iruanrivose2hf5bbfre6kgccd1dfp9q2f3v38cvg/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f into ede8be49db937c3a62b0dc3899496428/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_ - updating store file list. 2023-07-11 14:10:20,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_ into ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:20,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1fpepiuttd55h2h469dqhg6iruanrivose2hf5bbfre6kgccd1dfp9q2f3v38cvg/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f into ede8be49db937c3a62b0dc3899496428/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_) 2023-07-11 14:10:20,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1fpepiuttd55h2h469dqhg6iruanrivose2hf5bbfre6kgccd1dfp9q2f3v38cvg/family1/ef3cd0dd4ae94facad7c78b9a9e85f9f 2023-07-11 14:10:20,320 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:20,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:20,322 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c60e65353f11454fb72ec9d2370a9fdd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c60e65353f11454fb72ec9d2370a9fdd 2023-07-11 14:10:20,323 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201075c536814bd4da3b652eef1bd7588b7 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201075c536814bd4da3b652eef1bd7588b7 2023-07-11 14:10:20,346 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e354f23d10a54e46b11454ac63466c33 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e354f23d10a54e46b11454ac63466c33 2023-07-11 14:10:20,346 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x097eb855 to 127.0.0.1:63702 2023-07-11 14:10:20,346 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-07-11 14:10:20,346 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:20,346 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 14:10:20,346 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:20,346 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b4aaea9 to 127.0.0.1:63702 2023-07-11 14:10:20,346 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:20,346 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:20,346 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a757cbe to 127.0.0.1:63702 2023-07-11 14:10:20,346 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:20,346 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:20,347 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0878b308 to 127.0.0.1:63702 2023-07-11 14:10:20,347 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:20,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:20,347 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:20,347 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:20,348 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:20,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 699 msec 2023-07-11 14:10:20,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 14:10:20,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:20,662 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/b054acf1f95044a9b94999df56178d47 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/b054acf1f95044a9b94999df56178d47 2023-07-11 14:10:20,669 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ede8be49db937c3a62b0dc3899496428/family1 of ede8be49db937c3a62b0dc3899496428 into b054acf1f95044a9b94999df56178d47(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:20,669 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:20,670 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1689084620154; duration=0sec 2023-07-11 14:10:20,670 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:20,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/f31b58cd52dd47a89e2bfc47be5e1302, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/9e22baa08c094be8914c7a9b58b202c5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/873a595468e046cbbd73999d034e6b5e, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/707e2b6699b748c18f979ba9b9fae495, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/faafda7ae03642b5af1902cb1afd9dda, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8e23ed4790294d9ba127028b8e3b1e30, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/5e44ebe25ff44968a9d5ef2d50a7685d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8f2ee0b3a45b44bb821a97086bffdca5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/c493ed362d4e4a4e86e215a809b884d1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_] to archive 2023-07-11 14:10:20,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:20,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/f31b58cd52dd47a89e2bfc47be5e1302 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/f31b58cd52dd47a89e2bfc47be5e1302 2023-07-11 14:10:20,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/9e22baa08c094be8914c7a9b58b202c5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/9e22baa08c094be8914c7a9b58b202c5 2023-07-11 14:10:20,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/873a595468e046cbbd73999d034e6b5e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/873a595468e046cbbd73999d034e6b5e 2023-07-11 14:10:20,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/707e2b6699b748c18f979ba9b9fae495 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/707e2b6699b748c18f979ba9b9fae495 2023-07-11 14:10:20,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/faafda7ae03642b5af1902cb1afd9dda to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/faafda7ae03642b5af1902cb1afd9dda 2023-07-11 14:10:20,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8e23ed4790294d9ba127028b8e3b1e30 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8e23ed4790294d9ba127028b8e3b1e30 2023-07-11 14:10:20,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/5e44ebe25ff44968a9d5ef2d50a7685d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/5e44ebe25ff44968a9d5ef2d50a7685d 2023-07-11 14:10:20,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8f2ee0b3a45b44bb821a97086bffdca5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/8f2ee0b3a45b44bb821a97086bffdca5 2023-07-11 14:10:20,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/c493ed362d4e4a4e86e215a809b884d1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/c493ed362d4e4a4e86e215a809b884d1 2023-07-11 14:10:20,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/47b92e8998f84258aff8ef22045bb00c_SeqId_44_ 2023-07-11 14:10:20,888 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:20,890 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:20,890 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:20,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-07-11 14:10:20,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE}] 2023-07-11 14:10:20,896 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE 2023-07-11 14:10:20,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:20,897 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084620897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084620897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084620897"}]},"ts":"1689084620897"} 2023-07-11 14:10:20,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:21,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ede8be49db937c3a62b0dc3899496428, disabling compactions & flushes 2023-07-11 14:10:21,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. after waiting 0 ms 2023-07-11 14:10:21,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-07-11 14:10:21,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:21,057 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ede8be49db937c3a62b0dc3899496428 to self. 2023-07-11 14:10:21,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,059 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=CLOSED 2023-07-11 14:10:21,059 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084621059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084621059"}]},"ts":"1689084621059"} 2023-07-11 14:10:21,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-07-11 14:10:21,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537 in 162 msec 2023-07-11 14:10:21,065 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=true 2023-07-11 14:10:21,215 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:21,215 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084621215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084621215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084621215"}]},"ts":"1689084621215"} 2023-07-11 14:10:21,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:21,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ede8be49db937c3a62b0dc3899496428, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:10:21,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:21,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,375 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,376 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:21,377 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:21,377 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede8be49db937c3a62b0dc3899496428 columnFamilyName family1 2023-07-11 14:10:21,382 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_ 2023-07-11 14:10:21,386 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/25746deaf3d64a768d0b53baffd697e4 2023-07-11 14:10:21,389 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/b054acf1f95044a9b94999df56178d47 2023-07-11 14:10:21,389 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(310): Store=ede8be49db937c3a62b0dc3899496428/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:21,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:21,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ede8be49db937c3a62b0dc3899496428; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72290212, jitterRate=0.07720810174942017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:10:21,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:21,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., pid=63, masterSystemTime=1689084621370 2023-07-11 14:10:21,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:21,397 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 14:10:21,398 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 14:10:21,398 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1912): ede8be49db937c3a62b0dc3899496428/family1 is initiating minor compaction (all files) 2023-07-11 14:10:21,398 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ede8be49db937c3a62b0dc3899496428/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,398 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/25746deaf3d64a768d0b53baffd697e4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/b054acf1f95044a9b94999df56178d47, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp, totalSize=388.1 K 2023-07-11 14:10:21,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:21,399 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 25746deaf3d64a768d0b53baffd697e4, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878818110 2023-07-11 14:10:21,399 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:21,399 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084621398"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084621398"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084621398"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084621398"}]},"ts":"1689084621398"} 2023-07-11 14:10:21,399 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting b054acf1f95044a9b94999df56178d47, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621218110 2023-07-11 14:10:21,399 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 0a27e3d6bdff4868a290b563378132a8_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878818110 2023-07-11 14:10:21,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-07-11 14:10:21,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537 in 183 msec 2023-07-11 14:10:21,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-07-11 14:10:21,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE in 507 msec 2023-07-11 14:10:21,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-11 14:10:21,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 512 msec 2023-07-11 14:10:21,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 947 msec 2023-07-11 14:10:21,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-07-11 14:10:21,409 INFO [Listener at localhost/44533] compactions.TestMobCompactor(278): alter status finished 2023-07-11 14:10:21,410 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:21,411 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:21,414 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:21,415 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:21,415 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085221415 2023-07-11 14:10:21,415 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:10:21,416 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-11 14:10:21,416 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:21,416 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x0b4a89d8 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:21,424 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): ede8be49db937c3a62b0dc3899496428#family1#compaction#74 average throughput is 12.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:21,426 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a205020, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:21,426 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:21,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:21,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:21,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:21,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:22,255 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280931a5981e7f427da0b6652ecec8bb7c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280931a5981e7f427da0b6652ecec8bb7c 2023-07-11 14:10:22,256 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:22,268 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:22,269 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:22,276 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:10:22,277 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:10:22,285 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 first=Optional[r05] last=Optional[r8] 2023-07-11 14:10:22,286 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=50 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4}] 2023-07-11 14:10:22,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 for inclusion in ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:22,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-11 14:10:22,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:10:22,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:22,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2s1o95fpupv7iue9k4hpqfjd1e37hmthu1vs8kj98aqnseavt3v8u9fmq1i26goh/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 2023-07-11 14:10:22,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2s1o95fpupv7iue9k4hpqfjd1e37hmthu1vs8kj98aqnseavt3v8u9fmq1i26goh/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/651b1ebe835c43abad4d5c0fa1f0fab5_SeqId_52_ 2023-07-11 14:10:22,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2s1o95fpupv7iue9k4hpqfjd1e37hmthu1vs8kj98aqnseavt3v8u9fmq1i26goh/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 into ede8be49db937c3a62b0dc3899496428/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/651b1ebe835c43abad4d5c0fa1f0fab5_SeqId_52_ - updating store file list. 2023-07-11 14:10:22,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/651b1ebe835c43abad4d5c0fa1f0fab5_SeqId_52_ into ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:22,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2s1o95fpupv7iue9k4hpqfjd1e37hmthu1vs8kj98aqnseavt3v8u9fmq1i26goh/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 into ede8be49db937c3a62b0dc3899496428/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/651b1ebe835c43abad4d5c0fa1f0fab5_SeqId_52_) 2023-07-11 14:10:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2s1o95fpupv7iue9k4hpqfjd1e37hmthu1vs8kj98aqnseavt3v8u9fmq1i26goh/family1/f4d8db7ec4d44bf79d2b4edb36c68cd4 2023-07-11 14:10:22,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:22,302 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:22,304 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204681d9e23b5649e393bab45bde16cdcc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204681d9e23b5649e393bab45bde16cdcc 2023-07-11 14:10:22,305 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283a6d28c6e9b8451cb4c5b12357e41a4f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283a6d28c6e9b8451cb4c5b12357e41a4f 2023-07-11 14:10:22,305 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-07-11 14:10:22,305 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 14:10:22,305 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:22,305 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:22,305 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:22,305 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:22,305 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:22,306 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:22,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 895 msec 2023-07-11 14:10:22,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-07-11 14:10:22,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:22,376 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-07-11 14:10:22,378 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:22,378 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-07-11 14:10:22,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-07-11 14:10:22,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE}] 2023-07-11 14:10:22,384 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE 2023-07-11 14:10:22,384 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:22,384 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084622384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084622384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084622384"}]},"ts":"1689084622384"} 2023-07-11 14:10:22,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:22,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:22,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ede8be49db937c3a62b0dc3899496428, disabling compactions & flushes 2023-07-11 14:10:22,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:22,651 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/.tmp/family1/1233880a0133472e9f8c3158795af8ff as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/1233880a0133472e9f8c3158795af8ff 2023-07-11 14:10:22,657 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ede8be49db937c3a62b0dc3899496428/family1 of ede8be49db937c3a62b0dc3899496428 into 1233880a0133472e9f8c3158795af8ff(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 14:10:22,657 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:22,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:22,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:22,657 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., storeName=ede8be49db937c3a62b0dc3899496428/family1, priority=13, startTime=1689084621396; duration=1sec 2023-07-11 14:10:22,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. after waiting 0 ms 2023-07-11 14:10:22,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:22,658 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:22,658 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/25746deaf3d64a768d0b53baffd697e4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/b054acf1f95044a9b94999df56178d47, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_] to archive 2023-07-11 14:10:22,659 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:22,660 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/25746deaf3d64a768d0b53baffd697e4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/25746deaf3d64a768d0b53baffd697e4 2023-07-11 14:10:22,661 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/b054acf1f95044a9b94999df56178d47 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/b054acf1f95044a9b94999df56178d47 2023-07-11 14:10:22,663 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/0a27e3d6bdff4868a290b563378132a8_SeqId_46_ 2023-07-11 14:10:22,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-07-11 14:10:22,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:22,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:22,667 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ede8be49db937c3a62b0dc3899496428 to self. 2023-07-11 14:10:22,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:22,669 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=CLOSED 2023-07-11 14:10:22,669 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084622669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084622669"}]},"ts":"1689084622669"} 2023-07-11 14:10:22,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-11 14:10:22,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537 in 284 msec 2023-07-11 14:10:22,672 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=true 2023-07-11 14:10:22,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:22,823 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084622822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084622822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084622822"}]},"ts":"1689084622822"} 2023-07-11 14:10:22,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:22,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:22,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ede8be49db937c3a62b0dc3899496428, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:10:22,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:22,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:22,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:22,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:22,983 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:22,984 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:22,984 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1 2023-07-11 14:10:22,985 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede8be49db937c3a62b0dc3899496428 columnFamilyName family1 2023-07-11 14:10:22,998 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/1233880a0133472e9f8c3158795af8ff 2023-07-11 14:10:23,001 DEBUG [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/family1/651b1ebe835c43abad4d5c0fa1f0fab5_SeqId_52_ 2023-07-11 14:10:23,002 INFO [StoreOpener-ede8be49db937c3a62b0dc3899496428-1] regionserver.HStore(310): Store=ede8be49db937c3a62b0dc3899496428/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:23,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:23,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:23,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:10:23,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ede8be49db937c3a62b0dc3899496428; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69167049, jitterRate=0.03066934645175934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:10:23,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:10:23,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428., pid=69, masterSystemTime=1689084622976 2023-07-11 14:10:23,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:23,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:10:23,014 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ede8be49db937c3a62b0dc3899496428, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:23,014 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689084623014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084623014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084623014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084623014"}]},"ts":"1689084623014"} 2023-07-11 14:10:23,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-11 14:10:23,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure ede8be49db937c3a62b0dc3899496428, server=jenkins-hbase9.apache.org,46743,1689084553537 in 191 msec 2023-07-11 14:10:23,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-11 14:10:23,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ede8be49db937c3a62b0dc3899496428, REOPEN/MOVE in 634 msec 2023-07-11 14:10:23,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-11 14:10:23,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 640 msec 2023-07-11 14:10:23,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 659 msec 2023-07-11 14:10:23,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-07-11 14:10:23,028 INFO [Listener at localhost/44533] compactions.TestMobCompactor(278): alter status finished 2023-07-11 14:10:23,029 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 14:10:23,030 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:23,031 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:23,032 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:23,032 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085223031 2023-07-11 14:10:23,032 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:10:23,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-11 14:10:23,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:23,034 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x0b60162d to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:23,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@274d3616, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:23,070 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 14:10:23,071 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 14:10:23,071 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:23,072 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 14:10:23,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 42 msec 2023-07-11 14:10:23,153 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248 (was 256), OpenFileDescriptor=624 (was 634), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=599 (was 645), ProcessCount=181 (was 181), AvailableMemoryMB=250 (was 636) 2023-07-11 14:10:23,171 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=248, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=599, ProcessCount=180, AvailableMemoryMB=250 2023-07-11 14:10:23,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 14:10:23,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:23,178 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:10:23,179 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:10:23,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-07-11 14:10:23,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 14:10:23,181 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,181 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846 empty. 2023-07-11 14:10:23,182 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,182 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-07-11 14:10:23,198 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:23,199 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4427793ffb43262770478aaf7bf2846, NAME => 'testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:23,211 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:23,211 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing e4427793ffb43262770478aaf7bf2846, disabling compactions & flushes 2023-07-11 14:10:23,211 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:23,211 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:23,211 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. after waiting 0 ms 2023-07-11 14:10:23,211 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:23,211 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:23,211 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for e4427793ffb43262770478aaf7bf2846: 2023-07-11 14:10:23,213 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:10:23,215 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689084623214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084623214"}]},"ts":"1689084623214"} 2023-07-11 14:10:23,216 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:10:23,217 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:10:23,217 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084623217"}]},"ts":"1689084623217"} 2023-07-11 14:10:23,220 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-07-11 14:10:23,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4427793ffb43262770478aaf7bf2846, ASSIGN}] 2023-07-11 14:10:23,233 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4427793ffb43262770478aaf7bf2846, ASSIGN 2023-07-11 14:10:23,234 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4427793ffb43262770478aaf7bf2846, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:23,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 14:10:23,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e4427793ffb43262770478aaf7bf2846, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:23,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689084623385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084623385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084623385"}]},"ts":"1689084623385"} 2023-07-11 14:10:23,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure e4427793ffb43262770478aaf7bf2846, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:23,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 14:10:23,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:23,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4427793ffb43262770478aaf7bf2846, NAME => 'testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:10:23,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-07-11 14:10:23,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-07-11 14:10:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,544 INFO [StoreOpener-e4427793ffb43262770478aaf7bf2846-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,545 DEBUG [StoreOpener-e4427793ffb43262770478aaf7bf2846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1 2023-07-11 14:10:23,545 DEBUG [StoreOpener-e4427793ffb43262770478aaf7bf2846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1 2023-07-11 14:10:23,546 INFO [StoreOpener-e4427793ffb43262770478aaf7bf2846-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4427793ffb43262770478aaf7bf2846 columnFamilyName f1 2023-07-11 14:10:23,547 INFO [StoreOpener-e4427793ffb43262770478aaf7bf2846-1] regionserver.HStore(310): Store=e4427793ffb43262770478aaf7bf2846/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:23,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:23,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:23,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e4427793ffb43262770478aaf7bf2846; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70395445, jitterRate=0.048973873257637024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:10:23,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e4427793ffb43262770478aaf7bf2846: 2023-07-11 14:10:23,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846., pid=73, masterSystemTime=1689084623538 2023-07-11 14:10:23,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:23,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:23,555 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e4427793ffb43262770478aaf7bf2846, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:23,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689084623554"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084623554"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084623554"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084623554"}]},"ts":"1689084623554"} 2023-07-11 14:10:23,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-07-11 14:10:23,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure e4427793ffb43262770478aaf7bf2846, server=jenkins-hbase9.apache.org,46743,1689084553537 in 169 msec 2023-07-11 14:10:23,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-11 14:10:23,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4427793ffb43262770478aaf7bf2846, ASSIGN in 327 msec 2023-07-11 14:10:23,559 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:10:23,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084623559"}]},"ts":"1689084623559"} 2023-07-11 14:10:23,560 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-07-11 14:10:23,561 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:10:23,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 388 msec 2023-07-11 14:10:23,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 14:10:23,784 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-07-11 14:10:23,785 DEBUG [Listener at localhost/44533] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-07-11 14:10:23,787 INFO [Listener at localhost/44533] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 14:10:23,798 INFO [Listener at localhost/44533] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-07-11 14:10:23,799 INFO [Listener at localhost/44533] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 14:10:23,799 INFO [Listener at localhost/44533] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-07-11 14:10:23,805 INFO [Listener at localhost/44533] regionserver.HRegion(2745): Flushing e4427793ffb43262770478aaf7bf2846 1/1 column families, dataSize=37 B heapSize=368 B 2023-07-11 14:10:23,824 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711c77cdf85f70b4bd18c6dfc7953620a6a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711c77cdf85f70b4bd18c6dfc7953620a6a 2023-07-11 14:10:23,830 INFO [Listener at localhost/44533] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/.tmp/f1/6ab14d374f644291b9a34bf5fb37d26b 2023-07-11 14:10:23,836 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/.tmp/f1/6ab14d374f644291b9a34bf5fb37d26b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b 2023-07-11 14:10:23,841 INFO [Listener at localhost/44533] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b, entries=1, sequenceid=5, filesize=4.9 K 2023-07-11 14:10:23,842 INFO [Listener at localhost/44533] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for e4427793ffb43262770478aaf7bf2846 in 37ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:23,842 DEBUG [Listener at localhost/44533] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-07-11 14:10:23,843 DEBUG [Listener at localhost/44533] regionserver.HRegion(2446): Flush status journal for e4427793ffb43262770478aaf7bf2846: 2023-07-11 14:10:23,845 INFO [Listener at localhost/44533] regionserver.HRegion(2745): Flushing e4427793ffb43262770478aaf7bf2846 1/1 column families, dataSize=37 B heapSize=368 B 2023-07-11 14:10:24,266 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711881b1b8b044148689678db0864f7c682 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711881b1b8b044148689678db0864f7c682 2023-07-11 14:10:24,714 INFO [Listener at localhost/44533] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/.tmp/f1/505338be63d94952bb674dd183235dc3 2023-07-11 14:10:24,722 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/.tmp/f1/505338be63d94952bb674dd183235dc3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3 2023-07-11 14:10:24,735 INFO [Listener at localhost/44533] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3, entries=1, sequenceid=9, filesize=4.9 K 2023-07-11 14:10:24,737 INFO [Listener at localhost/44533] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for e4427793ffb43262770478aaf7bf2846 in 892ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:24,737 DEBUG [Listener at localhost/44533] regionserver.HRegion(2446): Flush status journal for e4427793ffb43262770478aaf7bf2846: 2023-07-11 14:10:24,740 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-07-11 14:10:24,742 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-11 14:10:24,742 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-11 14:10:24,743 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:24,743 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085224743 2023-07-11 14:10:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 14:10:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-07-11 14:10:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-07-11 14:10:24,745 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x7b48cf23 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:24,777 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35fbbbda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:24,778 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testGetAfterCompaction' and column='f1' 2023-07-11 14:10:24,792 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,793 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,844 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,844 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,895 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,895 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,946 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,946 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,997 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:24,997 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,048 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,048 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,099 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,099 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,150 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,150 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,201 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,201 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,252 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,252 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,273 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711ebb8528f4a004f66bdb7bab97e496f18 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711ebb8528f4a004f66bdb7bab97e496f18 2023-07-11 14:10:25,274 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testGetAfterCompaction' column='f1' 2023-07-11 14:10:25,288 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:25,289 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:25,296 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:10:25,298 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:10:25,303 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,303 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,309 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/a29681aaa7b64300ae621387964076c9 first=Optional[r1] last=Optional[r2] 2023-07-11 14:10:25,309 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{f1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/a29681aaa7b64300ae621387964076c9}] 2023-07-11 14:10:25,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/a29681aaa7b64300ae621387964076c9 for inclusion in e4427793ffb43262770478aaf7bf2846/f1 2023-07-11 14:10:25,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-07-11 14:10:25,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:10:25,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for e4427793ffb43262770478aaf7bf2846: 2023-07-11 14:10:25,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/a29681aaa7b64300ae621387964076c9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testGetAfterCompaction__qjfbrsvuntnmmbad64l519k3nlbrnl7pm9gtjif2f2tib2uom79ek8becgn8mate/f1/a29681aaa7b64300ae621387964076c9 2023-07-11 14:10:25,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testGetAfterCompaction__qjfbrsvuntnmmbad64l519k3nlbrnl7pm9gtjif2f2tib2uom79ek8becgn8mate/f1/a29681aaa7b64300ae621387964076c9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_ 2023-07-11 14:10:25,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testGetAfterCompaction__qjfbrsvuntnmmbad64l519k3nlbrnl7pm9gtjif2f2tib2uom79ek8becgn8mate/f1/a29681aaa7b64300ae621387964076c9 into e4427793ffb43262770478aaf7bf2846/f1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_ - updating store file list. 2023-07-11 14:10:25,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_ into e4427793ffb43262770478aaf7bf2846/f1 2023-07-11 14:10:25,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testGetAfterCompaction__qjfbrsvuntnmmbad64l519k3nlbrnl7pm9gtjif2f2tib2uom79ek8becgn8mate/f1/a29681aaa7b64300ae621387964076c9 into e4427793ffb43262770478aaf7bf2846/f1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_) 2023-07-11 14:10:25,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testGetAfterCompaction__qjfbrsvuntnmmbad64l519k3nlbrnl7pm9gtjif2f2tib2uom79ek8becgn8mate/f1/a29681aaa7b64300ae621387964076c9 2023-07-11 14:10:25,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): e4427793ffb43262770478aaf7bf2846/f1 is initiating minor compaction 2023-07-11 14:10:25,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2342db61; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:25,325 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e4427793ffb43262770478aaf7bf2846/f1 in testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:25,325 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/.tmp, totalSize=10.0 K 2023-07-11 14:10:25,325 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 505338be63d94952bb674dd183235dc3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:10:25,325 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 2875875368514c149b1a7086adffcd08_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:10:25,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testGetAfterCompaction' column='f1' 2023-07-11 14:10:25,328 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:25,330 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711881b1b8b044148689678db0864f7c682 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711881b1b8b044148689678db0864f7c682 2023-07-11 14:10:25,331 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711c77cdf85f70b4bd18c6dfc7953620a6a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711c77cdf85f70b4bd18c6dfc7953620a6a 2023-07-11 14:10:25,331 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-07-11 14:10:25,331 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 14:10:25,331 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testGetAfterCompaction' and column='f1' 2023-07-11 14:10:25,331 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-07-11 14:10:25,331 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:10:25,333 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-11 14:10:25,333 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): e4427793ffb43262770478aaf7bf2846#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:25,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 592 msec 2023-07-11 14:10:25,354 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,354 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,354 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,359 DEBUG [Listener at localhost/44533] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 14:10:25,363 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 14:10:25,364 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46743] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:25,364 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-07-11 14:10:25,364 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-07-11 14:10:25,364 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46743] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-07-11 14:10:25,365 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46743] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. because compaction request was cancelled 2023-07-11 14:10:25,416 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,416 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,416 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,467 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,467 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,467 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,518 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,518 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,519 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,569 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,569 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,570 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,620 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,620 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,621 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,672 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,672 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,672 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,723 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,723 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,723 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,774 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,774 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,774 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,825 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,826 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,826 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,877 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,877 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,877 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,928 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,928 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,928 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,979 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:25,979 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:25,979 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,030 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:26,030 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,031 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,082 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:26,082 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,082 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,133 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:26,134 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,134 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,151 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/.tmp/f1/5ac1ec3e0501460baeaa4a58f4f473cc as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/5ac1ec3e0501460baeaa4a58f4f473cc 2023-07-11 14:10:26,157 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in e4427793ffb43262770478aaf7bf2846/f1 of e4427793ffb43262770478aaf7bf2846 into 5ac1ec3e0501460baeaa4a58f4f473cc(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:26,157 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e4427793ffb43262770478aaf7bf2846: 2023-07-11 14:10:26,157 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1689084625324; duration=0sec 2023-07-11 14:10:26,157 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:26,185 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:26,185 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,185 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/5ac1ec3e0501460baeaa4a58f4f473cc; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1689084626144; access_time=1689084625330; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,185 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,236 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689084625268; access_time=1689084624795; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 14:10:26,236 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084624714; access_time=1689084623846; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,236 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/5ac1ec3e0501460baeaa4a58f4f473cc; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1689084626144; access_time=1689084625330; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,236 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_] to archive 2023-07-11 14:10:26,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:26,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/505338be63d94952bb674dd183235dc3 2023-07-11 14:10:26,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/2875875368514c149b1a7086adffcd08_SeqId_12_ 2023-07-11 14:10:26,287 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/5ac1ec3e0501460baeaa4a58f4f473cc; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1689084626144; access_time=1689084625330; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,287 INFO [Listener at localhost/44533] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689084623830; access_time=1689084623808; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 14:10:26,414 INFO [Listener at localhost/44533] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-07-11 14:10:26,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testGetAfterCompaction 2023-07-11 14:10:26,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:26,431 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084626430"}]},"ts":"1689084626430"} 2023-07-11 14:10:26,432 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-07-11 14:10:26,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-11 14:10:26,437 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-07-11 14:10:26,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4427793ffb43262770478aaf7bf2846, UNASSIGN}] 2023-07-11 14:10:26,441 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4427793ffb43262770478aaf7bf2846, UNASSIGN 2023-07-11 14:10:26,442 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e4427793ffb43262770478aaf7bf2846, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:26,442 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689084626442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084626442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084626442"}]},"ts":"1689084626442"} 2023-07-11 14:10:26,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure e4427793ffb43262770478aaf7bf2846, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:26,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-11 14:10:26,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:26,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e4427793ffb43262770478aaf7bf2846, disabling compactions & flushes 2023-07-11 14:10:26,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:26,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:26,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. after waiting 0 ms 2023-07-11 14:10:26,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:26,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-07-11 14:10:26,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-07-11 14:10:26,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846. 2023-07-11 14:10:26,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e4427793ffb43262770478aaf7bf2846: 2023-07-11 14:10:26,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:26,603 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e4427793ffb43262770478aaf7bf2846, regionState=CLOSED 2023-07-11 14:10:26,603 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689084626603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084626603"}]},"ts":"1689084626603"} 2023-07-11 14:10:26,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-11 14:10:26,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure e4427793ffb43262770478aaf7bf2846, server=jenkins-hbase9.apache.org,46743,1689084553537 in 161 msec 2023-07-11 14:10:26,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-07-11 14:10:26,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=e4427793ffb43262770478aaf7bf2846, UNASSIGN in 165 msec 2023-07-11 14:10:26,607 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084626607"}]},"ts":"1689084626607"} 2023-07-11 14:10:26,608 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-07-11 14:10:26,610 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:10:26,614 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-07-11 14:10:26,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 192 msec 2023-07-11 14:10:26,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-11 14:10:26,739 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-07-11 14:10:26,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testGetAfterCompaction 2023-07-11 14:10:26,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:26,751 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:26,753 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:26,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-11 14:10:26,756 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:26,759 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1, FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/recovered.edits] 2023-07-11 14:10:26,763 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/5ac1ec3e0501460baeaa4a58f4f473cc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/5ac1ec3e0501460baeaa4a58f4f473cc 2023-07-11 14:10:26,765 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/f1/6ab14d374f644291b9a34bf5fb37d26b 2023-07-11 14:10:26,768 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/recovered.edits/15.seqid to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846/recovered.edits/15.seqid 2023-07-11 14:10:26,769 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testGetAfterCompaction/e4427793ffb43262770478aaf7bf2846 2023-07-11 14:10:26,769 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-07-11 14:10:26,769 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-07-11 14:10:26,770 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-07-11 14:10:26,775 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711ebb8528f4a004f66bdb7bab97e496f18 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711ebb8528f4a004f66bdb7bab97e496f18 2023-07-11 14:10:26,775 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-07-11 14:10:26,777 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:26,800 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-07-11 14:10:26,803 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-07-11 14:10:26,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:26,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-07-11 14:10:26,804 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689084626804"}]},"ts":"9223372036854775807"} 2023-07-11 14:10:26,805 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 14:10:26,805 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e4427793ffb43262770478aaf7bf2846, NAME => 'testGetAfterCompaction,,1689084623173.e4427793ffb43262770478aaf7bf2846.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 14:10:26,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-07-11 14:10:26,806 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689084626806"}]},"ts":"9223372036854775807"} 2023-07-11 14:10:26,807 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-07-11 14:10:26,810 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 14:10:26,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 65 msec 2023-07-11 14:10:26,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-11 14:10:26,855 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-07-11 14:10:26,869 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=253 (was 248) - Thread LEAK? -, OpenFileDescriptor=632 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=615 (was 599) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=1233 (was 250) - AvailableMemoryMB LEAK? - 2023-07-11 14:10:26,882 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=253, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=615, ProcessCount=181, AvailableMemoryMB=1232 2023-07-11 14:10:26,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 14:10:26,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-07-11 14:10:26,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:10:26,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-07-11 14:10:26,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:10:26,896 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:26,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 14:10:26,900 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:26,901 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:26,901 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5 empty. 2023-07-11 14:10:26,901 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a empty. 2023-07-11 14:10:26,902 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:26,902 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:26,907 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac empty. 2023-07-11 14:10:26,907 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:26,907 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-07-11 14:10:26,923 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:26,926 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => d1dffee09ccc83fe54e67efb91e2730a, NAME => 'testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:26,926 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9aaa666cabc8359a75b55d380a2e4fac, NAME => 'testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:26,926 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7b4c3e810294b74f730a671a9718e5b5, NAME => 'testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:26,949 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:26,949 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 7b4c3e810294b74f730a671a9718e5b5, disabling compactions & flushes 2023-07-11 14:10:26,949 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:26,949 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:26,949 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. after waiting 0 ms 2023-07-11 14:10:26,949 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:26,949 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:26,949 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:26,950 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:26,951 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 9aaa666cabc8359a75b55d380a2e4fac, disabling compactions & flushes 2023-07-11 14:10:26,951 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:26,951 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:26,951 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. after waiting 0 ms 2023-07-11 14:10:26,951 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:26,951 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:26,951 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:27,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 14:10:27,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 14:10:27,345 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:27,345 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing d1dffee09ccc83fe54e67efb91e2730a, disabling compactions & flushes 2023-07-11 14:10:27,345 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:27,345 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:27,345 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. after waiting 0 ms 2023-07-11 14:10:27,345 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:27,345 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:27,345 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:27,348 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:10:27,349 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084627349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084627349"}]},"ts":"1689084627349"} 2023-07-11 14:10:27,350 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084627349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084627349"}]},"ts":"1689084627349"} 2023-07-11 14:10:27,350 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084627349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084627349"}]},"ts":"1689084627349"} 2023-07-11 14:10:27,362 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 14:10:27,363 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:10:27,363 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084627363"}]},"ts":"1689084627363"} 2023-07-11 14:10:27,365 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-07-11 14:10:27,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN}] 2023-07-11 14:10:27,375 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN 2023-07-11 14:10:27,375 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN 2023-07-11 14:10:27,375 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN 2023-07-11 14:10:27,376 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:27,376 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:27,376 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:27,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 14:10:27,528 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7b4c3e810294b74f730a671a9718e5b5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:27,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084627528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084627528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084627528"}]},"ts":"1689084627528"} 2023-07-11 14:10:27,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=d1dffee09ccc83fe54e67efb91e2730a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:27,529 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084627529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084627529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084627529"}]},"ts":"1689084627529"} 2023-07-11 14:10:27,529 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=9aaa666cabc8359a75b55d380a2e4fac, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:27,530 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084627529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084627529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084627529"}]},"ts":"1689084627529"} 2023-07-11 14:10:27,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 7b4c3e810294b74f730a671a9718e5b5, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:27,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure d1dffee09ccc83fe54e67efb91e2730a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:27,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 9aaa666cabc8359a75b55d380a2e4fac, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:27,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:27,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b4c3e810294b74f730a671a9718e5b5, NAME => 'testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 14:10:27,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:27,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,705 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,707 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:27,707 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:27,707 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b4c3e810294b74f730a671a9718e5b5 columnFamilyName family1 2023-07-11 14:10:27,709 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(310): Store=7b4c3e810294b74f730a671a9718e5b5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:27,709 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,710 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2 2023-07-11 14:10:27,710 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2 2023-07-11 14:10:27,711 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b4c3e810294b74f730a671a9718e5b5 columnFamilyName family2 2023-07-11 14:10:27,712 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(310): Store=7b4c3e810294b74f730a671a9718e5b5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:27,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:27,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:27,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:27,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7b4c3e810294b74f730a671a9718e5b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59037780, jitterRate=-0.12026852369308472}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:27,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:27,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5., pid=83, masterSystemTime=1689084627699 2023-07-11 14:10:27,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:27,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:27,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:27,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9aaa666cabc8359a75b55d380a2e4fac, NAME => 'testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 14:10:27,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,720 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7b4c3e810294b74f730a671a9718e5b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:27,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:27,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,721 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084627720"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084627720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084627720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084627720"}]},"ts":"1689084627720"} 2023-07-11 14:10:27,722 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,723 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:27,723 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:27,724 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aaa666cabc8359a75b55d380a2e4fac columnFamilyName family1 2023-07-11 14:10:27,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-07-11 14:10:27,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 7b4c3e810294b74f730a671a9718e5b5, server=jenkins-hbase9.apache.org,46743,1689084553537 in 191 msec 2023-07-11 14:10:27,724 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(310): Store=9aaa666cabc8359a75b55d380a2e4fac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:27,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN in 353 msec 2023-07-11 14:10:27,725 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,726 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2 2023-07-11 14:10:27,726 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2 2023-07-11 14:10:27,726 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aaa666cabc8359a75b55d380a2e4fac columnFamilyName family2 2023-07-11 14:10:27,727 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(310): Store=9aaa666cabc8359a75b55d380a2e4fac/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:27,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:27,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:27,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:27,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9aaa666cabc8359a75b55d380a2e4fac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67178563, jitterRate=0.0010385960340499878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:27,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:27,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac., pid=85, masterSystemTime=1689084627699 2023-07-11 14:10:27,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:27,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:27,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:27,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1dffee09ccc83fe54e67efb91e2730a, NAME => 'testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 14:10:27,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,735 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=9aaa666cabc8359a75b55d380a2e4fac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:27,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:27,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084627735"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084627735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084627735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084627735"}]},"ts":"1689084627735"} 2023-07-11 14:10:27,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,736 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,737 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:27,737 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:27,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-07-11 14:10:27,738 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1dffee09ccc83fe54e67efb91e2730a columnFamilyName family1 2023-07-11 14:10:27,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 9aaa666cabc8359a75b55d380a2e4fac, server=jenkins-hbase9.apache.org,46743,1689084553537 in 204 msec 2023-07-11 14:10:27,738 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(310): Store=d1dffee09ccc83fe54e67efb91e2730a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:27,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN in 367 msec 2023-07-11 14:10:27,739 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,740 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2 2023-07-11 14:10:27,740 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2 2023-07-11 14:10:27,740 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1dffee09ccc83fe54e67efb91e2730a columnFamilyName family2 2023-07-11 14:10:27,741 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(310): Store=d1dffee09ccc83fe54e67efb91e2730a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:27,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:27,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:27,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:27,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d1dffee09ccc83fe54e67efb91e2730a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70028503, jitterRate=0.04350601136684418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:27,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:27,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a., pid=84, masterSystemTime=1689084627699 2023-07-11 14:10:27,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:27,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:27,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=d1dffee09ccc83fe54e67efb91e2730a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:27,750 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084627749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084627749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084627749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084627749"}]},"ts":"1689084627749"} 2023-07-11 14:10:27,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-07-11 14:10:27,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure d1dffee09ccc83fe54e67efb91e2730a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 219 msec 2023-07-11 14:10:27,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-07-11 14:10:27,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN in 380 msec 2023-07-11 14:10:27,754 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:10:27,754 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084627754"}]},"ts":"1689084627754"} 2023-07-11 14:10:27,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-07-11 14:10:27,757 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:10:27,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 873 msec 2023-07-11 14:10:28,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 14:10:28,005 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-07-11 14:10:28,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:28,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:28,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:28,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:28,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 14:10:28,021 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 14:10:28,021 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:28,021 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 14:10:28,021 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 14:10:28,021 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,021 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,023 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-07-11 14:10:28,024 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:28,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:28,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,024 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 14:10:28,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 14:10:28,025 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 14:10:28,025 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:28,025 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 14:10:28,028 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:28,028 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. started... 2023-07-11 14:10:28,029 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:28,029 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:28,029 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:28,029 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:28,029 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. started... 2023-07-11 14:10:28,029 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. started... 2023-07-11 14:10:28,029 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1dffee09ccc83fe54e67efb91e2730a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:10:28,031 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9aaa666cabc8359a75b55d380a2e4fac 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:10:28,031 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b4c3e810294b74f730a671a9718e5b5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:10:28,079 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 2023-07-11 14:10:28,089 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 2023-07-11 14:10:28,122 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/3bd3a528948b4b2a979f08e87c07609a 2023-07-11 14:10:28,124 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/9d1c5c1cc3d143caa968fe72bf590213 2023-07-11 14:10:28,515 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 2023-07-11 14:10:28,525 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/ed037c7fa5b744f2986a00d577d352fb 2023-07-11 14:10:28,562 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071149c4def362c445f1853a4949ee962fdb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071149c4def362c445f1853a4949ee962fdb 2023-07-11 14:10:28,563 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711e0bd76febc8348b8bb99237356687e8d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711e0bd76febc8348b8bb99237356687e8d 2023-07-11 14:10:28,600 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071123885ebe3d424c52ad9e3187dc12bc8c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071123885ebe3d424c52ad9e3187dc12bc8c 2023-07-11 14:10:28,615 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/1aeebd8cda414df8be74302f75ed1c85 2023-07-11 14:10:28,615 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/37653409f4b34c9db5f325ee9a4987b0 2023-07-11 14:10:28,623 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/fd25f1f516544790a81c98b7784c49e8 2023-07-11 14:10:28,626 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/9d1c5c1cc3d143caa968fe72bf590213 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213 2023-07-11 14:10:28,627 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/3bd3a528948b4b2a979f08e87c07609a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a 2023-07-11 14:10:28,633 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 14:10:28,634 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/ed037c7fa5b744f2986a00d577d352fb as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb 2023-07-11 14:10:28,638 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 14:10:28,639 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/1aeebd8cda414df8be74302f75ed1c85 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85 2023-07-11 14:10:28,641 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/37653409f4b34c9db5f325ee9a4987b0 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0 2023-07-11 14:10:28,644 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:10:28,644 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 14:10:28,645 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d1dffee09ccc83fe54e67efb91e2730a in 616ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:28,646 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:28,646 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:28,646 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:28,647 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/fd25f1f516544790a81c98b7784c49e8 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8 2023-07-11 14:10:28,650 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:10:28,651 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9aaa666cabc8359a75b55d380a2e4fac in 621ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:28,652 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:28,652 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:28,652 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:28,655 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:10:28,656 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7b4c3e810294b74f730a671a9718e5b5 in 625ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:28,656 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:28,656 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:28,656 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:28,656 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:28,656 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,656 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 14:10:28,656 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 14:10:28,658 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,658 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:28,658 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,658 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:28,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:28,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 14:10:28,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c2d4e00[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:28,660 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 14:10:28,660 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,661 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,662 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 14:10:28,662 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 14:10:28,662 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:28,662 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,662 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:28,663 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,663 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 14:10:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:28,663 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:28,663 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 14:10:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:28,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:28,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:28,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:28,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 14:10:28,665 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 14:10:28,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:28,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:28,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 14:10:28,666 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:28,668 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,668 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:28,668 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:28,669 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:28,671 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,673 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,673 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:28,673 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:28,673 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:28,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 14:10:28,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:28,673 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 14:10:28,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:28,674 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:28,674 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:28,674 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:28,674 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,674 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,674 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:28,674 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:28,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:28,774 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:28,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:28,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:28,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:28,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:28,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:28,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:28,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 14:10:28,786 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 14:10:28,787 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:28,787 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 14:10:28,787 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 14:10:28,788 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,788 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,789 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,789 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:28,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:28,790 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:28,790 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:28,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 14:10:28,792 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-11 14:10:28,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 14:10:28,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 14:10:28,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:28,792 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 14:10:28,793 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:28,794 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. started... 2023-07-11 14:10:28,794 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:28,794 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. started... 2023-07-11 14:10:28,794 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1dffee09ccc83fe54e67efb91e2730a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:10:28,794 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b4c3e810294b74f730a671a9718e5b5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:10:28,797 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:28,798 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:28,798 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:28,798 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. started... 2023-07-11 14:10:28,798 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9aaa666cabc8359a75b55d380a2e4fac 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:10:28,894 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 2023-07-11 14:10:29,274 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d 2023-07-11 14:10:29,290 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e 2023-07-11 14:10:29,313 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/87934dd23a9541408f5005f4ad5baf8c 2023-07-11 14:10:29,334 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/7c4031e09a9c472e8231631adaeca156 2023-07-11 14:10:29,365 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711f58190c531e344c786a62c5644675e27 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711f58190c531e344c786a62c5644675e27 2023-07-11 14:10:29,682 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/b5721087d2754ac89cf73a45339403c1 2023-07-11 14:10:29,753 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307111ec2f425338d4868b06c7c4daf329b49 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307111ec2f425338d4868b06c7c4daf329b49 2023-07-11 14:10:29,782 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/087c9ce23e54459a8dd9852bce4f1a8f 2023-07-11 14:10:29,788 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/7c4031e09a9c472e8231631adaeca156 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156 2023-07-11 14:10:29,791 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/d149fdc4364b4631891d3333258f5290 2023-07-11 14:10:29,794 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 14:10:29,795 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/087c9ce23e54459a8dd9852bce4f1a8f as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f 2023-07-11 14:10:29,805 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/87934dd23a9541408f5005f4ad5baf8c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c 2023-07-11 14:10:29,823 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:10:29,824 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d1dffee09ccc83fe54e67efb91e2730a in 1030ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:29,824 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:29,824 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:29,824 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:29,825 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 14:10:29,826 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/d149fdc4364b4631891d3333258f5290 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290 2023-07-11 14:10:29,842 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:10:29,843 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7b4c3e810294b74f730a671a9718e5b5 in 1049ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:29,843 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:29,843 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:29,843 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:30,129 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071189b74e74620c46e593d6f64928aeee82 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071189b74e74620c46e593d6f64928aeee82 2023-07-11 14:10:30,137 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/270804cab88943debd5680faf46e9c7b 2023-07-11 14:10:30,143 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/b5721087d2754ac89cf73a45339403c1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1 2023-07-11 14:10:30,149 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 14:10:30,150 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/270804cab88943debd5680faf46e9c7b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b 2023-07-11 14:10:30,185 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:10:30,187 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9aaa666cabc8359a75b55d380a2e4fac in 1389ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:30,187 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:30,187 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:30,187 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:30,187 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:30,187 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,187 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 14:10:30,187 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 14:10:30,189 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,189 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:30,189 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,189 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:30,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 14:10:30,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17131cc8[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:30,191 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 14:10:30,191 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,193 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,193 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 14:10:30,193 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 14:10:30,193 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:30,195 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,195 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:30,197 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 14:10:30,197 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:30,197 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 14:10:30,197 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:30,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:30,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:30,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 14:10:30,201 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 14:10:30,201 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:30,201 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:30,201 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 14:10:30,201 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:30,207 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,207 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:30,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:30,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,207 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:30,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:30,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:30,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,210 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:30,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:30,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:30,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:30,214 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:30,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:30,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,224 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:30,224 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:30,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:30,224 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:30,224 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 14:10:30,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:30,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 14:10:30,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:30,225 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:30,225 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:30,225 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:30,225 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:30,225 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:30,226 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,226 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:30,226 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,325 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:30,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:30,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:30,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:30,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:30,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:30,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:30,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 14:10:30,345 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 14:10:30,346 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:30,346 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 14:10:30,346 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 14:10:30,346 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,346 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:30,348 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:30,348 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:30,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:30,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:30,349 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:30,349 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:30,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:30,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:30,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:30,349 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 14:10:30,350 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-11 14:10:30,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 14:10:30,350 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 14:10:30,350 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:30,350 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 14:10:30,351 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:30,352 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. started... 2023-07-11 14:10:30,352 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:30,352 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. started... 2023-07-11 14:10:30,352 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:30,352 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:30,352 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1dffee09ccc83fe54e67efb91e2730a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:10:30,352 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b4c3e810294b74f730a671a9718e5b5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:10:30,352 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:30,352 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. started... 2023-07-11 14:10:30,353 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9aaa666cabc8359a75b55d380a2e4fac 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:10:30,412 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a 2023-07-11 14:10:30,444 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/78ddc0f18926451b8d22d3879cd4abae 2023-07-11 14:10:30,800 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 2023-07-11 14:10:30,809 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 2023-07-11 14:10:30,873 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c987cf9f18f14bdcba80b2ab069ecb2a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711c987cf9f18f14bdcba80b2ab069ecb2a 2023-07-11 14:10:30,881 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/9d7adc16d81f478494f21276b7021abe 2023-07-11 14:10:30,895 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/78ddc0f18926451b8d22d3879cd4abae as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae 2023-07-11 14:10:30,900 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 14:10:30,901 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/9d7adc16d81f478494f21276b7021abe as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe 2023-07-11 14:10:30,909 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:10:30,910 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7b4c3e810294b74f730a671a9718e5b5 in 558ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:30,911 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:30,911 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:30,911 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:31,207 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/e4a5ab29f5054cc39ca35b54d808db5b 2023-07-11 14:10:31,215 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/27e5531119bb4764add0330a9c25ea0a 2023-07-11 14:10:31,224 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711cee4c23c3fbe4fcf859606b43340cd1d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711cee4c23c3fbe4fcf859606b43340cd1d 2023-07-11 14:10:31,231 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711100d076514254c3391a2cdada2d53a62 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711100d076514254c3391a2cdada2d53a62 2023-07-11 14:10:31,632 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/9e3a84cc98e7437ba0993261023412e4 2023-07-11 14:10:31,637 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/69d549fbed334684890ca913703bae1a 2023-07-11 14:10:31,639 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/e4a5ab29f5054cc39ca35b54d808db5b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b 2023-07-11 14:10:31,645 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/27e5531119bb4764add0330a9c25ea0a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a 2023-07-11 14:10:31,647 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 14:10:31,648 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/9e3a84cc98e7437ba0993261023412e4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4 2023-07-11 14:10:31,650 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 14:10:31,651 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/69d549fbed334684890ca913703bae1a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a 2023-07-11 14:10:31,653 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:10:31,654 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9aaa666cabc8359a75b55d380a2e4fac in 1302ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:31,654 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:31,654 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:31,654 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:31,656 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:10:31,658 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d1dffee09ccc83fe54e67efb91e2730a in 1306ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:31,658 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:31,658 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:31,658 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:31,658 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:31,658 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,659 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 14:10:31,659 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 14:10:31,662 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,662 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:31,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:31,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:31,663 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,663 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:31,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:31,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:31,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:31,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 14:10:31,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73bfa5d2[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:31,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 14:10:31,666 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,670 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,670 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 14:10:31,670 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,670 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:31,670 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 14:10:31,670 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:31,673 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 14:10:31,673 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,673 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:31,673 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 14:10:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:31,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 14:10:31,676 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 14:10:31,676 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:31,676 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:31,676 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 14:10:31,676 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:31,683 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,683 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:31,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,683 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:31,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:31,684 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:31,685 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,688 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:31,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 14:10:31,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:31,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,688 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:31,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:31,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 14:10:31,789 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:31,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:31,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:31,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:31,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:31,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 14:10:31,797 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 14:10:31,797 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:31,797 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 14:10:31,797 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 14:10:31,798 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,798 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:31,799 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,799 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:31,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:31,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:31,799 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:31,799 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:31,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:31,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:31,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:31,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:31,800 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 14:10:31,801 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-11 14:10:31,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 14:10:31,801 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 14:10:31,801 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:31,801 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 14:10:31,802 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:31,802 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. started... 2023-07-11 14:10:31,802 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:31,802 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. started... 2023-07-11 14:10:31,802 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1dffee09ccc83fe54e67efb91e2730a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:10:31,802 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b4c3e810294b74f730a671a9718e5b5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:10:31,803 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:31,803 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:31,803 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:31,804 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. started... 2023-07-11 14:10:31,804 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9aaa666cabc8359a75b55d380a2e4fac 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:10:31,873 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 2023-07-11 14:10:31,873 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d 2023-07-11 14:10:32,103 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:10:32,273 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b 2023-07-11 14:10:32,287 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/2d65d572ca3a4e9b99810ded67bc9399 2023-07-11 14:10:32,299 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/43ed1d1baffe40f29cd4ae64c7c87857 2023-07-11 14:10:32,300 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/a050038d656443f99802915606bd3710 2023-07-11 14:10:32,318 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307111a9619a363354a0081a1e3e73948d317 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111a9619a363354a0081a1e3e73948d317 2023-07-11 14:10:32,376 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711466a7daa1f5d4e66bcfb2efc0c76e4f7 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711466a7daa1f5d4e66bcfb2efc0c76e4f7 2023-07-11 14:10:32,760 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/a6b9d38f77ca4131b91956061470e1b9 2023-07-11 14:10:32,767 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/2d65d572ca3a4e9b99810ded67bc9399 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399 2023-07-11 14:10:32,772 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 14:10:32,772 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/a6b9d38f77ca4131b91956061470e1b9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9 2023-07-11 14:10:32,776 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711a46ff656a2ed40c9b5ab0cc258fc16bb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711a46ff656a2ed40c9b5ab0cc258fc16bb 2023-07-11 14:10:32,779 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:10:32,780 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9aaa666cabc8359a75b55d380a2e4fac in 976ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:32,780 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:32,780 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:32,780 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:32,788 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/63f4146d55e74f5399636a6250597c92 2023-07-11 14:10:32,793 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/a050038d656443f99802915606bd3710 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710 2023-07-11 14:10:32,797 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 14:10:32,798 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/63f4146d55e74f5399636a6250597c92 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92 2023-07-11 14:10:32,802 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:10:32,803 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d1dffee09ccc83fe54e67efb91e2730a in 1001ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:32,803 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:32,803 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:32,803 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:33,182 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/cb828fff040046279bc2780823d9e649 2023-07-11 14:10:33,192 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/43ed1d1baffe40f29cd4ae64c7c87857 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857 2023-07-11 14:10:33,197 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 14:10:33,198 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/cb828fff040046279bc2780823d9e649 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649 2023-07-11 14:10:33,213 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:10:33,214 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7b4c3e810294b74f730a671a9718e5b5 in 1412ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:33,214 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:33,214 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:33,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:33,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:33,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 14:10:33,214 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 14:10:33,216 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,216 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:33,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:33,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:33,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:33,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:33,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:33,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:33,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 14:10:33,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46d1716[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:33,219 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 14:10:33,220 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,221 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,221 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 14:10:33,221 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 14:10:33,221 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:33,221 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,221 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:33,223 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 14:10:33,223 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:33,223 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 14:10:33,223 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:33,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:33,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:33,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:33,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:33,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:33,227 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 14:10:33,227 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:33,227 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:33,227 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 14:10:33,227 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:33,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 14:10:33,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:33,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:33,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:33,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:33,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:33,231 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:33,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:33,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:33,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:33,238 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:33,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 14:10:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:33,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 14:10:33,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:33,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,239 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:33,239 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:33,239 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:33,239 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:33,339 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:33,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:33,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 14:10:33,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689084633354 (current time:1689084633354). 2023-07-11 14:10:33,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 14:10:33,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] zookeeper.ReadOnlyZKClient(139): Connect 0x499fe2ac to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cfbd5ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:33,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:33,385 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:33,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x499fe2ac to 127.0.0.1:63702 2023-07-11 14:10:33,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:33,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 14:10:33,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 14:10:33,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 14:10:33,399 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 14:10:33,399 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1689085233399 2023-07-11 14:10:33,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 14:10:33,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1689084633340 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-07-11 14:10:33,401 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 14:10:33,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-07-11 14:10:33,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-11 14:10:33,404 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-11 14:10:33,405 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1689085233405 2023-07-11 14:10:33,407 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:33,407 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 14:10:33,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1689084633340 2023-07-11 14:10:33,430 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1689084633340' 2023-07-11 14:10:33,430 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 14:10:33,430 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1689084633340' starting 'acquire' 2023-07-11 14:10:33,430 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1689084633340', kicking off acquire phase on members. 2023-07-11 14:10:33,430 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,430 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1689084633340 2023-07-11 14:10:33,433 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 14:10:33,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 14:10:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 14:10:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1689084633340 2023-07-11 14:10:33,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-07-11 14:10:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1689084633340 2023-07-11 14:10:33,435 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1689084633340 from table testCompactionWithHFileLink type FLUSH 2023-07-11 14:10:33,436 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,438 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1689084633340 2023-07-11 14:10:33,438 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:33,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1689084633340' with timeout 300000ms 2023-07-11 14:10:33,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 14:10:33,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1689084633340' starting 'acquire' stage 2023-07-11 14:10:33,439 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1689084633340' locally acquired 2023-07-11 14:10:33,440 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (snaptb-1689084633340) in zk 2023-07-11 14:10:33,443 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,443 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 14:10:33,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:33,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1689084633340' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689084633340 2023-07-11 14:10:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:33,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'snaptb-1689084633340' on coordinator 2023-07-11 14:10:33,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@122614d5[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:33,446 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1689084633340' starting 'in-barrier' execution. 2023-07-11 14:10:33,446 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,448 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,448 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,448 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1689084633340' received 'reached' from coordinator. 2023-07-11 14:10:33,448 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:33,449 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:33,449 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:33,450 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. started... 2023-07-11 14:10:33,450 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. started... 2023-07-11 14:10:33,450 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:33,450 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:33,451 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.' region-info for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,451 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.' region-info for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,451 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:33,451 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-07-11 14:10:33,451 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. started... 2023-07-11 14:10:33,451 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 14:10:33,451 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:33,451 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.' region-info for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,458 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 14:10:33,459 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 14:10:33,459 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 14:10:33,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710] hfiles 2023-07-11 14:10:33,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399] hfiles 2023-07-11 14:10:33,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857] hfiles 2023-07-11 14:10:33,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,468 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,468 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,468 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,468 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,468 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9] hfiles 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92] hfiles 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,470 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,470 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,469 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649] hfiles 2023-07-11 14:10:33,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,474 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649 for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,507 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:33,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:33,510 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. completed. 2023-07-11 14:10:33,510 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:33,510 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-07-11 14:10:33,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:33,511 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 14:10:33,712 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:33,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:33,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:33,713 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 14:10:33,907 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. completed. 2023-07-11 14:10:33,907 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:33,907 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-07-11 14:10:33,916 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. completed. 2023-07-11 14:10:33,916 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:33,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-07-11 14:10:33,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-07-11 14:10:33,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1689084633340' locally completed 2023-07-11 14:10:33,916 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1689084633340' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:33,918 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1689084633340' has notified controller of completion 2023-07-11 14:10:33,918 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,918 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 14:10:33,918 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1689084633340' completed. 2023-07-11 14:10:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689084633340 2023-07-11 14:10:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689084633340 2023-07-11 14:10:33,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1689084633340' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:33,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'snaptb-1689084633340', counting down latch. Waiting for 0 more 2023-07-11 14:10:33,921 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1689084633340' execution completed 2023-07-11 14:10:33,921 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:33,921 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:33,921 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1689084633340 2023-07-11 14:10:33,921 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1689084633340including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 14:10:33,923 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,923 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,923 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 14:10:33,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 14:10:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:33,924 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 14:10:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 14:10:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689084633340 2023-07-11 14:10:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689084633340 2023-07-11 14:10:33,926 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689084633340 2023-07-11 14:10:33,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689084633340 2023-07-11 14:10:33,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1689084633340 because node does not exist (not an error) 2023-07-11 14:10:33,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1689084633340 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689084633340 2023-07-11 14:10:33,929 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:33,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-07-11 14:10:33,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689084633340/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1689084633340 2023-07-11 14:10:33,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 14:10:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689084633340 2023-07-11 14:10:33,929 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689084633340 2023-07-11 14:10:33,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 14:10:33,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 14:10:33,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d] mob files 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b 2023-07-11 14:10:33,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d 2023-07-11 14:10:33,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307111ec2f425338d4868b06c7c4daf329b49, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071123885ebe3d424c52ad9e3187dc12bc8c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711a46ff656a2ed40c9b5ab0cc258fc16bb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711c987cf9f18f14bdcba80b2ab069ecb2a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711100d076514254c3391a2cdada2d53a62, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711466a7daa1f5d4e66bcfb2efc0c76e4f7, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711e0bd76febc8348b8bb99237356687e8d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711f58190c531e344c786a62c5644675e27, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111a9619a363354a0081a1e3e73948d317, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071149c4def362c445f1853a4949ee962fdb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071189b74e74620c46e593d6f64928aeee82, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711cee4c23c3fbe4fcf859606b43340cd1d] mob files 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307111ec2f425338d4868b06c7c4daf329b49 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071123885ebe3d424c52ad9e3187dc12bc8c 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711a46ff656a2ed40c9b5ab0cc258fc16bb 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711c987cf9f18f14bdcba80b2ab069ecb2a 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711100d076514254c3391a2cdada2d53a62 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711466a7daa1f5d4e66bcfb2efc0c76e4f7 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711e0bd76febc8348b8bb99237356687e8d 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711f58190c531e344c786a62c5644675e27 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111a9619a363354a0081a1e3e73948d317 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071149c4def362c445f1853a4949ee962fdb 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071189b74e74620c46e593d6f64928aeee82 2023-07-11 14:10:33,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711cee4c23c3fbe4fcf859606b43340cd1d 2023-07-11 14:10:34,013 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:34,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:34,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:34,015 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 14:10:34,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1689084633340 2023-07-11 14:10:34,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/snaptb-1689084633340 2023-07-11 14:10:34,515 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:34,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:34,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:34,516 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 14:10:34,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/snaptb-1689084633340 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/snaptb-1689084633340 2023-07-11 14:10:35,280 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1689084633340 of table testCompactionWithHFileLink completed 2023-07-11 14:10:35,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/snaptb-1689084633340 2023-07-11 14:10:35,281 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/snaptb-1689084633340 2023-07-11 14:10:35,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1689084633340 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1689084633400Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1689084634342 (+942 ms)Consolidate snapshot: snaptb-1689084633340 at 1689084634342Loading Region manifests for snaptb-1689084633340 at 1689084634342Writing data manifest for snaptb-1689084633340 at 1689084634373 (+31 ms)Verifying snapshot: snaptb-1689084633340 at 1689084634782 (+409 ms)Snapshot snaptb-1689084633340 of table testCompactionWithHFileLink completed at 1689084635280 (+498 ms) 2023-07-11 14:10:35,282 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-11 14:10:35,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.8800 sec 2023-07-11 14:10:35,516 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 14:10:35,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:35,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:35,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 14:10:35,580 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 14:10:35,580 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:35,580 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 14:10:35,580 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 14:10:35,580 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:35,580 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:35,582 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:35,582 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:35,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:35,582 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:35,582 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:35,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:35,583 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 14:10:35,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-11 14:10:35,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 14:10:35,598 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 14:10:35,598 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:35,598 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 14:10:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. started... 2023-07-11 14:10:35,610 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d1dffee09ccc83fe54e67efb91e2730a 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:10:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. started... 2023-07-11 14:10:35,610 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b4c3e810294b74f730a671a9718e5b5 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:10:35,610 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:35,610 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. started... 2023-07-11 14:10:35,610 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9aaa666cabc8359a75b55d380a2e4fac 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:10:35,695 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/4042d45ab00b4fc8a9020aaa8ec4e080 2023-07-11 14:10:35,701 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4042d45ab00b4fc8a9020aaa8ec4e080 2023-07-11 14:10:35,702 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/c0392d3453ef40e88c224dc82656949c 2023-07-11 14:10:35,707 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/91e092b844e742e58c7c230c6422ec00 2023-07-11 14:10:35,708 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0392d3453ef40e88c224dc82656949c 2023-07-11 14:10:35,714 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91e092b844e742e58c7c230c6422ec00 2023-07-11 14:10:35,999 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-07-11 14:10:35,999 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:35,999 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b48cf23 to 127.0.0.1:63702 2023-07-11 14:10:35,999 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:35,999 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b60162d to 127.0.0.1:63702 2023-07-11 14:10:36,000 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:36,000 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:36,000 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e48a118 to 127.0.0.1:63702 2023-07-11 14:10:36,000 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:36,000 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:36,000 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b4a89d8 to 127.0.0.1:63702 2023-07-11 14:10:36,000 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:36,187 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/b0152417dab04b40bae7700396d05a07 2023-07-11 14:10:36,196 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0152417dab04b40bae7700396d05a07 2023-07-11 14:10:36,201 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/c0392d3453ef40e88c224dc82656949c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c0392d3453ef40e88c224dc82656949c 2023-07-11 14:10:36,209 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0392d3453ef40e88c224dc82656949c 2023-07-11 14:10:36,209 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c0392d3453ef40e88c224dc82656949c, entries=3, sequenceid=24, filesize=5.0 K 2023-07-11 14:10:36,211 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/b0152417dab04b40bae7700396d05a07 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/b0152417dab04b40bae7700396d05a07 2023-07-11 14:10:36,240 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0152417dab04b40bae7700396d05a07 2023-07-11 14:10:36,240 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/b0152417dab04b40bae7700396d05a07, entries=1, sequenceid=24, filesize=5.0 K 2023-07-11 14:10:36,242 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7b4c3e810294b74f730a671a9718e5b5 in 632ms, sequenceid=24, compaction requested=true 2023-07-11 14:10:36,242 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:36,242 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:36,242 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:36,419 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/629ea4174e7648d9b5a79f00da9c3b43 2023-07-11 14:10:36,423 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 629ea4174e7648d9b5a79f00da9c3b43 2023-07-11 14:10:36,424 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/91e092b844e742e58c7c230c6422ec00 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/91e092b844e742e58c7c230c6422ec00 2023-07-11 14:10:36,429 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91e092b844e742e58c7c230c6422ec00 2023-07-11 14:10:36,429 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/91e092b844e742e58c7c230c6422ec00, entries=3, sequenceid=24, filesize=5.0 K 2023-07-11 14:10:36,433 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/629ea4174e7648d9b5a79f00da9c3b43 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/629ea4174e7648d9b5a79f00da9c3b43 2023-07-11 14:10:36,440 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 629ea4174e7648d9b5a79f00da9c3b43 2023-07-11 14:10:36,441 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/629ea4174e7648d9b5a79f00da9c3b43, entries=1, sequenceid=24, filesize=5.0 K 2023-07-11 14:10:36,442 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9aaa666cabc8359a75b55d380a2e4fac in 832ms, sequenceid=24, compaction requested=true 2023-07-11 14:10:36,442 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:36,442 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:36,443 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:36,562 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/1715307a77d74d62b32c6a76508243bb 2023-07-11 14:10:36,572 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1715307a77d74d62b32c6a76508243bb 2023-07-11 14:10:36,572 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/4042d45ab00b4fc8a9020aaa8ec4e080 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/4042d45ab00b4fc8a9020aaa8ec4e080 2023-07-11 14:10:36,576 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4042d45ab00b4fc8a9020aaa8ec4e080 2023-07-11 14:10:36,577 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/4042d45ab00b4fc8a9020aaa8ec4e080, entries=3, sequenceid=24, filesize=5.0 K 2023-07-11 14:10:36,577 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/1715307a77d74d62b32c6a76508243bb as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1715307a77d74d62b32c6a76508243bb 2023-07-11 14:10:36,583 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1715307a77d74d62b32c6a76508243bb 2023-07-11 14:10:36,583 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1715307a77d74d62b32c6a76508243bb, entries=1, sequenceid=24, filesize=5.0 K 2023-07-11 14:10:36,585 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d1dffee09ccc83fe54e67efb91e2730a in 975ms, sequenceid=24, compaction requested=true 2023-07-11 14:10:36,585 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:36,585 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:36,585 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:36,585 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:36,585 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,585 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 14:10:36,585 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 14:10:36,587 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,587 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:36,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:36,588 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,588 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:36,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:36,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:36,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:36,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:36,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 14:10:36,590 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 14:10:36,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ddcaf05[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:36,590 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,594 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,595 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 14:10:36,595 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 14:10:36,595 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:36,595 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,595 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:36,597 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 14:10:36,597 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,597 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,597 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 14:10:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:36,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:36,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:36,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:36,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:36,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:36,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 14:10:36,601 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 14:10:36,601 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:36,601 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:36,601 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 14:10:36,601 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:36,602 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:36,602 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:36,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:36,602 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:36,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:36,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:36,605 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:36,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:36,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:36,606 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 14:10:36,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:36,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:36,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:36,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 14:10:36,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 14:10:36,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:36,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:36,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:36,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:36,609 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:36,610 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:36,610 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:36,609 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,610 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 14:10:36,610 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 14:10:36,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:36,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:36,712 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:36,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:36,714 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:36,714 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): d1dffee09ccc83fe54e67efb91e2730a/family1 is initiating major compaction (all files) 2023-07-11 14:10:36,714 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:36,715 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:36,715 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of d1dffee09ccc83fe54e67efb91e2730a/family1 in testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:36,715 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/4042d45ab00b4fc8a9020aaa8ec4e080] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp, totalSize=26.7 K 2023-07-11 14:10:36,716 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 9d1c5c1cc3d143caa968fe72bf590213, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:36,716 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 7c4031e09a9c472e8231631adaeca156, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:36,718 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 27e5531119bb4764add0330a9c25ea0a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:36,718 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting a050038d656443f99802915606bd3710, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:36,719 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 4042d45ab00b4fc8a9020aaa8ec4e080, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 14:10:36,748 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): d1dffee09ccc83fe54e67efb91e2730a#family1#compaction#108 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:37,165 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307110bde6fdaeabe45c6a7e51e8d385760cf_del 2023-07-11 14:10:37,165 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307110bde6fdaeabe45c6a7e51e8d385760cf_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307110bde6fdaeabe45c6a7e51e8d385760cf_del 2023-07-11 14:10:37,179 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2ebb70b6f1846eab96cb8a9bb58d2b6 2023-07-11 14:10:37,180 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/d2ebb70b6f1846eab96cb8a9bb58d2b6 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d2ebb70b6f1846eab96cb8a9bb58d2b6 2023-07-11 14:10:37,184 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2ebb70b6f1846eab96cb8a9bb58d2b6 2023-07-11 14:10:37,185 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d1dffee09ccc83fe54e67efb91e2730a/family1 of d1dffee09ccc83fe54e67efb91e2730a into d2ebb70b6f1846eab96cb8a9bb58d2b6(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:37,186 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:37,186 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:37,186 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): d1dffee09ccc83fe54e67efb91e2730a/family2 is initiating major compaction (all files) 2023-07-11 14:10:37,186 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:37,186 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:37,186 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of d1dffee09ccc83fe54e67efb91e2730a/family2 in testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:37,186 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1715307a77d74d62b32c6a76508243bb] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp, totalSize=25.4 K 2023-07-11 14:10:37,187 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 1aeebd8cda414df8be74302f75ed1c85, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:37,187 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 087c9ce23e54459a8dd9852bce4f1a8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:37,188 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 69d549fbed334684890ca913703bae1a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:37,188 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 63f4146d55e74f5399636a6250597c92, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:37,189 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 1715307a77d74d62b32c6a76508243bb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 14:10:37,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/4042d45ab00b4fc8a9020aaa8ec4e080] to archive 2023-07-11 14:10:37,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:37,202 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): d1dffee09ccc83fe54e67efb91e2730a#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:37,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/9d1c5c1cc3d143caa968fe72bf590213 2023-07-11 14:10:37,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/7c4031e09a9c472e8231631adaeca156 2023-07-11 14:10:37,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/27e5531119bb4764add0330a9c25ea0a 2023-07-11 14:10:37,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/a050038d656443f99802915606bd3710 2023-07-11 14:10:37,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/4042d45ab00b4fc8a9020aaa8ec4e080 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/4042d45ab00b4fc8a9020aaa8ec4e080 2023-07-11 14:10:37,612 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307113cfdbb7c4ef245c69bb4c82a7f7a012f_del 2023-07-11 14:10:37,613 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307113cfdbb7c4ef245c69bb4c82a7f7a012f_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307113cfdbb7c4ef245c69bb4c82a7f7a012f_del 2023-07-11 14:10:38,431 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a378b59437b4b629c6f6ee123e2a9c6 2023-07-11 14:10:38,432 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/6a378b59437b4b629c6f6ee123e2a9c6 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/6a378b59437b4b629c6f6ee123e2a9c6 2023-07-11 14:10:38,435 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a378b59437b4b629c6f6ee123e2a9c6 2023-07-11 14:10:38,436 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d1dffee09ccc83fe54e67efb91e2730a/family2 of d1dffee09ccc83fe54e67efb91e2730a into 6a378b59437b4b629c6f6ee123e2a9c6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 14:10:38,436 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:38,436 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:38,436 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 7b4c3e810294b74f730a671a9718e5b5/family1 is initiating major compaction (all files) 2023-07-11 14:10:38,436 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:38,436 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:38,437 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 7b4c3e810294b74f730a671a9718e5b5/family1 in testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:38,437 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c0392d3453ef40e88c224dc82656949c] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp, totalSize=26.7 K 2023-07-11 14:10:38,437 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting ed037c7fa5b744f2986a00d577d352fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:38,438 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 87934dd23a9541408f5005f4ad5baf8c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:38,438 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 78ddc0f18926451b8d22d3879cd4abae, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:38,438 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 43ed1d1baffe40f29cd4ae64c7c87857, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:38,438 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting c0392d3453ef40e88c224dc82656949c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 14:10:38,448 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 7b4c3e810294b74f730a671a9718e5b5#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:38,460 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711dc27007d4bbe4405a28ba41cfb51dd22_del 2023-07-11 14:10:38,460 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711dc27007d4bbe4405a28ba41cfb51dd22_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711dc27007d4bbe4405a28ba41cfb51dd22_del 2023-07-11 14:10:38,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1715307a77d74d62b32c6a76508243bb] to archive 2023-07-11 14:10:38,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:38,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1aeebd8cda414df8be74302f75ed1c85 2023-07-11 14:10:38,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/087c9ce23e54459a8dd9852bce4f1a8f 2023-07-11 14:10:38,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/69d549fbed334684890ca913703bae1a 2023-07-11 14:10:38,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/63f4146d55e74f5399636a6250597c92 2023-07-11 14:10:38,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1715307a77d74d62b32c6a76508243bb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/1715307a77d74d62b32c6a76508243bb 2023-07-11 14:10:38,891 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c6ef8add5b1e41768265e240eb975461 2023-07-11 14:10:38,892 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/c6ef8add5b1e41768265e240eb975461 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c6ef8add5b1e41768265e240eb975461 2023-07-11 14:10:38,898 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c6ef8add5b1e41768265e240eb975461 2023-07-11 14:10:38,899 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b4c3e810294b74f730a671a9718e5b5/family1 of 7b4c3e810294b74f730a671a9718e5b5 into c6ef8add5b1e41768265e240eb975461(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:38,900 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:38,900 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:38,900 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 7b4c3e810294b74f730a671a9718e5b5/family2 is initiating major compaction (all files) 2023-07-11 14:10:38,900 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:38,900 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:38,900 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 7b4c3e810294b74f730a671a9718e5b5/family2 in testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:38,901 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/b0152417dab04b40bae7700396d05a07] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp, totalSize=25.4 K 2023-07-11 14:10:38,901 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting fd25f1f516544790a81c98b7784c49e8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:38,902 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting d149fdc4364b4631891d3333258f5290, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:38,902 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 9d7adc16d81f478494f21276b7021abe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:38,903 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting cb828fff040046279bc2780823d9e649, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:38,904 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting b0152417dab04b40bae7700396d05a07, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 14:10:38,920 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 7b4c3e810294b74f730a671a9718e5b5#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:38,927 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711054d24ed956e48e89e9ee9b0377d3d47_del 2023-07-11 14:10:38,928 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711054d24ed956e48e89e9ee9b0377d3d47_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711054d24ed956e48e89e9ee9b0377d3d47_del 2023-07-11 14:10:39,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c0392d3453ef40e88c224dc82656949c] to archive 2023-07-11 14:10:39,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:39,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ed037c7fa5b744f2986a00d577d352fb 2023-07-11 14:10:39,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/87934dd23a9541408f5005f4ad5baf8c 2023-07-11 14:10:39,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/78ddc0f18926451b8d22d3879cd4abae 2023-07-11 14:10:39,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/43ed1d1baffe40f29cd4ae64c7c87857 2023-07-11 14:10:39,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c0392d3453ef40e88c224dc82656949c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c0392d3453ef40e88c224dc82656949c 2023-07-11 14:10:39,741 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 865b117766444774b836fe654cad3073 2023-07-11 14:10:39,742 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/865b117766444774b836fe654cad3073 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/865b117766444774b836fe654cad3073 2023-07-11 14:10:39,747 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 865b117766444774b836fe654cad3073 2023-07-11 14:10:39,748 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b4c3e810294b74f730a671a9718e5b5/family2 of 7b4c3e810294b74f730a671a9718e5b5 into 865b117766444774b836fe654cad3073(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:39,748 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:39,748 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:39,748 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 9aaa666cabc8359a75b55d380a2e4fac/family1 is initiating major compaction (all files) 2023-07-11 14:10:39,748 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:39,748 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:39,748 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 9aaa666cabc8359a75b55d380a2e4fac/family1 in testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:39,748 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/91e092b844e742e58c7c230c6422ec00] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp, totalSize=26.7 K 2023-07-11 14:10:39,749 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 3bd3a528948b4b2a979f08e87c07609a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628013 2023-07-11 14:10:39,749 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting b5721087d2754ac89cf73a45339403c1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:39,750 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting e4a5ab29f5054cc39ca35b54d808db5b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630328 2023-07-11 14:10:39,750 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 2d65d572ca3a4e9b99810ded67bc9399, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631791 2023-07-11 14:10:39,750 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 91e092b844e742e58c7c230c6422ec00, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 14:10:39,778 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 9aaa666cabc8359a75b55d380a2e4fac#family1#compaction#112 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:39,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/b0152417dab04b40bae7700396d05a07] to archive 2023-07-11 14:10:39,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:39,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/fd25f1f516544790a81c98b7784c49e8 2023-07-11 14:10:39,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/d149fdc4364b4631891d3333258f5290 2023-07-11 14:10:39,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/9d7adc16d81f478494f21276b7021abe 2023-07-11 14:10:39,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/cb828fff040046279bc2780823d9e649 2023-07-11 14:10:39,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/b0152417dab04b40bae7700396d05a07 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/b0152417dab04b40bae7700396d05a07 2023-07-11 14:10:40,191 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711973cf89b829940fb865bebffa7d33045_del 2023-07-11 14:10:40,191 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711973cf89b829940fb865bebffa7d33045_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711973cf89b829940fb865bebffa7d33045_del 2023-07-11 14:10:40,647 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6835066dac06455ea1af9e8010042914 2023-07-11 14:10:40,649 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/6835066dac06455ea1af9e8010042914 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/6835066dac06455ea1af9e8010042914 2023-07-11 14:10:40,674 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6835066dac06455ea1af9e8010042914 2023-07-11 14:10:40,675 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9aaa666cabc8359a75b55d380a2e4fac/family1 of 9aaa666cabc8359a75b55d380a2e4fac into 6835066dac06455ea1af9e8010042914(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:40,675 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:40,675 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:40,676 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 9aaa666cabc8359a75b55d380a2e4fac/family2 is initiating major compaction (all files) 2023-07-11 14:10:40,676 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:40,676 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:40,676 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 9aaa666cabc8359a75b55d380a2e4fac/family2 in testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:40,676 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/629ea4174e7648d9b5a79f00da9c3b43] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp, totalSize=25.4 K 2023-07-11 14:10:40,677 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 37653409f4b34c9db5f325ee9a4987b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628013 2023-07-11 14:10:40,677 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 270804cab88943debd5680faf46e9c7b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:40,678 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 9e3a84cc98e7437ba0993261023412e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630328 2023-07-11 14:10:40,678 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting a6b9d38f77ca4131b91956061470e1b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631791 2023-07-11 14:10:40,679 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 629ea4174e7648d9b5a79f00da9c3b43, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 14:10:40,698 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 9aaa666cabc8359a75b55d380a2e4fac#family2#compaction#113 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:40,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/91e092b844e742e58c7c230c6422ec00] to archive 2023-07-11 14:10:40,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:40,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3bd3a528948b4b2a979f08e87c07609a 2023-07-11 14:10:40,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/b5721087d2754ac89cf73a45339403c1 2023-07-11 14:10:40,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/e4a5ab29f5054cc39ca35b54d808db5b 2023-07-11 14:10:40,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/2d65d572ca3a4e9b99810ded67bc9399 2023-07-11 14:10:40,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/91e092b844e742e58c7c230c6422ec00 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/91e092b844e742e58c7c230c6422ec00 2023-07-11 14:10:41,111 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023071155f466e7ea2b4970b9a3194c13dc4306_del 2023-07-11 14:10:41,111 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071155f466e7ea2b4970b9a3194c13dc4306_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071155f466e7ea2b4970b9a3194c13dc4306_del 2023-07-11 14:10:41,191 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea7ad07deb194790a6f97c2cdc7ce973 2023-07-11 14:10:41,198 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/ea7ad07deb194790a6f97c2cdc7ce973 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/ea7ad07deb194790a6f97c2cdc7ce973 2023-07-11 14:10:41,204 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea7ad07deb194790a6f97c2cdc7ce973 2023-07-11 14:10:41,205 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9aaa666cabc8359a75b55d380a2e4fac/family2 of 9aaa666cabc8359a75b55d380a2e4fac into ea7ad07deb194790a6f97c2cdc7ce973(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:41,205 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:41,229 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:41,234 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:41,240 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:41,241 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:41,267 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 14:10:41,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/629ea4174e7648d9b5a79f00da9c3b43] to archive 2023-07-11 14:10:41,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:41,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/37653409f4b34c9db5f325ee9a4987b0 2023-07-11 14:10:41,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/270804cab88943debd5680faf46e9c7b 2023-07-11 14:10:41,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/9e3a84cc98e7437ba0993261023412e4 2023-07-11 14:10:41,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/a6b9d38f77ca4131b91956061470e1b9 2023-07-11 14:10:41,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/629ea4174e7648d9b5a79f00da9c3b43 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/629ea4174e7648d9b5a79f00da9c3b43 2023-07-11 14:10:41,323 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-07-11 14:10:41,326 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711973cf89b829940fb865bebffa7d33045_del 2023-07-11 14:10:41,331 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711dc27007d4bbe4405a28ba41cfb51dd22_del 2023-07-11 14:10:41,338 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307110bde6fdaeabe45c6a7e51e8d385760cf_del 2023-07-11 14:10:41,338 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:41,339 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(139): Connect 0x3f1743e2 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:41,360 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62010438, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:41,361 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:41,362 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:41,366 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:41,640 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711b2750a80afc341c088f77558eba56629 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711b2750a80afc341c088f77558eba56629 2023-07-11 14:10:41,641 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:41,661 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:41,670 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:41,695 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:10:41,697 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:10:41,725 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b81c2d27e30f40e1bc103cc1b6e0389e first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-07-11 14:10:41,726 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b81c2d27e30f40e1bc103cc1b6e0389e}] 2023-07-11 14:10:41,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b81c2d27e30f40e1bc103cc1b6e0389e for inclusion in 7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:41,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-07-11 14:10:41,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 14:10:41,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:41,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b81c2d27e30f40e1bc103cc1b6e0389e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__52ilvrc6deighnd7ompr7qaoa46eoq1dolrrut51tvg2v377peoo54oe46o12f53/family1/b81c2d27e30f40e1bc103cc1b6e0389e 2023-07-11 14:10:41,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__52ilvrc6deighnd7ompr7qaoa46eoq1dolrrut51tvg2v377peoo54oe46o12f53/family1/b81c2d27e30f40e1bc103cc1b6e0389e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_ 2023-07-11 14:10:41,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__52ilvrc6deighnd7ompr7qaoa46eoq1dolrrut51tvg2v377peoo54oe46o12f53/family1/b81c2d27e30f40e1bc103cc1b6e0389e into 7b4c3e810294b74f730a671a9718e5b5/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_ - updating store file list. 2023-07-11 14:10:41,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_ into 7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:41,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__52ilvrc6deighnd7ompr7qaoa46eoq1dolrrut51tvg2v377peoo54oe46o12f53/family1/b81c2d27e30f40e1bc103cc1b6e0389e into 7b4c3e810294b74f730a671a9718e5b5/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_) 2023-07-11 14:10:41,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__52ilvrc6deighnd7ompr7qaoa46eoq1dolrrut51tvg2v377peoo54oe46o12f53/family1/b81c2d27e30f40e1bc103cc1b6e0389e 2023-07-11 14:10:41,761 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:41,762 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:41,766 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 2023-07-11 14:10:41,767 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 2023-07-11 14:10:41,768 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a 2023-07-11 14:10:41,770 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e 2023-07-11 14:10:41,770 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 14:10:41,770 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 14:10:41,771 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:42,431 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307113efee98c2c2848b6b0dd21a8dcb941df to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307113efee98c2c2848b6b0dd21a8dcb941df 2023-07-11 14:10:42,433 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:42,449 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307112dfb156269104fcaa7e352b22d5b9ee3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307112dfb156269104fcaa7e352b22d5b9ee3 2023-07-11 14:10:42,456 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:42,513 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/6258dcbd27554fbb9987ae01e8c44f74 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-07-11 14:10:42,516 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/6258dcbd27554fbb9987ae01e8c44f74}] 2023-07-11 14:10:42,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/6258dcbd27554fbb9987ae01e8c44f74 for inclusion in d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:42,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-07-11 14:10:42,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 14:10:42,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:42,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/6258dcbd27554fbb9987ae01e8c44f74 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__hq2s110rkfa5v11d7cqhl3lumln21jhjfvpa80lmcgabh8va1uhi9tpms3g1uojd/family1/6258dcbd27554fbb9987ae01e8c44f74 2023-07-11 14:10:42,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__hq2s110rkfa5v11d7cqhl3lumln21jhjfvpa80lmcgabh8va1uhi9tpms3g1uojd/family1/6258dcbd27554fbb9987ae01e8c44f74 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_ 2023-07-11 14:10:42,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__hq2s110rkfa5v11d7cqhl3lumln21jhjfvpa80lmcgabh8va1uhi9tpms3g1uojd/family1/6258dcbd27554fbb9987ae01e8c44f74 into d1dffee09ccc83fe54e67efb91e2730a/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_ - updating store file list. 2023-07-11 14:10:42,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_ into d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:42,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__hq2s110rkfa5v11d7cqhl3lumln21jhjfvpa80lmcgabh8va1uhi9tpms3g1uojd/family1/6258dcbd27554fbb9987ae01e8c44f74 into d1dffee09ccc83fe54e67efb91e2730a/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_) 2023-07-11 14:10:42,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__hq2s110rkfa5v11d7cqhl3lumln21jhjfvpa80lmcgabh8va1uhi9tpms3g1uojd/family1/6258dcbd27554fbb9987ae01e8c44f74 2023-07-11 14:10:42,559 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:42,561 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:42,563 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 2023-07-11 14:10:42,565 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/32394dd6e65844c08ae9b521199a5854 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-07-11 14:10:42,566 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 2023-07-11 14:10:42,566 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/32394dd6e65844c08ae9b521199a5854}] 2023-07-11 14:10:42,567 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 2023-07-11 14:10:42,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/32394dd6e65844c08ae9b521199a5854 for inclusion in 9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:42,569 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d 2023-07-11 14:10:42,569 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 14:10:42,569 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 14:10:42,570 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:42,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-07-11 14:10:42,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 14:10:42,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:42,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/32394dd6e65844c08ae9b521199a5854 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__dv93q02um98jpn1rss78f776ggu928vau3lpri0ifsjtp2ut8j2hp0elab74me59/family1/32394dd6e65844c08ae9b521199a5854 2023-07-11 14:10:42,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__dv93q02um98jpn1rss78f776ggu928vau3lpri0ifsjtp2ut8j2hp0elab74me59/family1/32394dd6e65844c08ae9b521199a5854 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_ 2023-07-11 14:10:42,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__dv93q02um98jpn1rss78f776ggu928vau3lpri0ifsjtp2ut8j2hp0elab74me59/family1/32394dd6e65844c08ae9b521199a5854 into 9aaa666cabc8359a75b55d380a2e4fac/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_ - updating store file list. 2023-07-11 14:10:42,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_ into 9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:42,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__dv93q02um98jpn1rss78f776ggu928vau3lpri0ifsjtp2ut8j2hp0elab74me59/family1/32394dd6e65844c08ae9b521199a5854 into 9aaa666cabc8359a75b55d380a2e4fac/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_) 2023-07-11 14:10:42,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__dv93q02um98jpn1rss78f776ggu928vau3lpri0ifsjtp2ut8j2hp0elab74me59/family1/32394dd6e65844c08ae9b521199a5854 2023-07-11 14:10:42,584 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:42,585 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:42,594 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 2023-07-11 14:10:42,595 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 2023-07-11 14:10:42,597 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b 2023-07-11 14:10:42,598 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d 2023-07-11 14:10:42,598 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 14:10:42,598 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 14:10:42,599 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:42,599 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:42,599 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:42,599 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711973cf89b829940fb865bebffa7d33045_del] 2023-07-11 14:10:42,600 DEBUG [Listener at localhost/44533] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:42,603 DEBUG [Listener at localhost/44533] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711973cf89b829940fb865bebffa7d33045_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711973cf89b829940fb865bebffa7d33045_del 2023-07-11 14:10:42,603 INFO [Listener at localhost/44533] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-11 14:10:42,603 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711dc27007d4bbe4405a28ba41cfb51dd22_del] 2023-07-11 14:10:42,604 DEBUG [Listener at localhost/44533] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:42,605 DEBUG [Listener at localhost/44533] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711dc27007d4bbe4405a28ba41cfb51dd22_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711dc27007d4bbe4405a28ba41cfb51dd22_del 2023-07-11 14:10:42,605 INFO [Listener at localhost/44533] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-11 14:10:42,605 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307110bde6fdaeabe45c6a7e51e8d385760cf_del] 2023-07-11 14:10:42,606 DEBUG [Listener at localhost/44533] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:42,607 DEBUG [Listener at localhost/44533] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307110bde6fdaeabe45c6a7e51e8d385760cf_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307110bde6fdaeabe45c6a7e51e8d385760cf_del 2023-07-11 14:10:42,607 INFO [Listener at localhost/44533] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-11 14:10:42,610 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:42,612 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:42,619 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:42,620 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:42,629 INFO [Listener at localhost/44533] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-07-11 14:10:42,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testCompactionWithHFileLink 2023-07-11 14:10:42,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-07-11 14:10:42,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-11 14:10:42,641 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084642641"}]},"ts":"1689084642641"} 2023-07-11 14:10:42,642 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-07-11 14:10:42,644 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-07-11 14:10:42,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, UNASSIGN}] 2023-07-11 14:10:42,648 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, UNASSIGN 2023-07-11 14:10:42,648 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, UNASSIGN 2023-07-11 14:10:42,648 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, UNASSIGN 2023-07-11 14:10:42,648 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=d1dffee09ccc83fe54e67efb91e2730a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:42,649 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084642648"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084642648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084642648"}]},"ts":"1689084642648"} 2023-07-11 14:10:42,649 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=7b4c3e810294b74f730a671a9718e5b5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:42,649 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=9aaa666cabc8359a75b55d380a2e4fac, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:42,649 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084642649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084642649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084642649"}]},"ts":"1689084642649"} 2023-07-11 14:10:42,649 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084642649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084642649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084642649"}]},"ts":"1689084642649"} 2023-07-11 14:10:42,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure d1dffee09ccc83fe54e67efb91e2730a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:42,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 7b4c3e810294b74f730a671a9718e5b5, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:42,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 9aaa666cabc8359a75b55d380a2e4fac, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:42,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-11 14:10:42,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:42,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d1dffee09ccc83fe54e67efb91e2730a, disabling compactions & flushes 2023-07-11 14:10:42,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:42,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:42,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. after waiting 0 ms 2023-07-11 14:10:42,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:42,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-11 14:10:42,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:42,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:42,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:42,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:42,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7b4c3e810294b74f730a671a9718e5b5, disabling compactions & flushes 2023-07-11 14:10:42,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:42,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:42,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. after waiting 0 ms 2023-07-11 14:10:42,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:42,815 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=d1dffee09ccc83fe54e67efb91e2730a, regionState=CLOSED 2023-07-11 14:10:42,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084642815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084642815"}]},"ts":"1689084642815"} 2023-07-11 14:10:42,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-07-11 14:10:42,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure d1dffee09ccc83fe54e67efb91e2730a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 164 msec 2023-07-11 14:10:42,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, UNASSIGN in 174 msec 2023-07-11 14:10:42,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-11 14:10:42,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:42,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:42,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:42,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9aaa666cabc8359a75b55d380a2e4fac, disabling compactions & flushes 2023-07-11 14:10:42,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. after waiting 0 ms 2023-07-11 14:10:42,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:42,843 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=7b4c3e810294b74f730a671a9718e5b5, regionState=CLOSED 2023-07-11 14:10:42,843 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084642843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084642843"}]},"ts":"1689084642843"} 2023-07-11 14:10:42,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-07-11 14:10:42,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 7b4c3e810294b74f730a671a9718e5b5, server=jenkins-hbase9.apache.org,46743,1689084553537 in 190 msec 2023-07-11 14:10:42,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, UNASSIGN in 202 msec 2023-07-11 14:10:42,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-11 14:10:42,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:42,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:42,857 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=9aaa666cabc8359a75b55d380a2e4fac, regionState=CLOSED 2023-07-11 14:10:42,858 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084642857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084642857"}]},"ts":"1689084642857"} 2023-07-11 14:10:42,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-07-11 14:10:42,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 9aaa666cabc8359a75b55d380a2e4fac, server=jenkins-hbase9.apache.org,46743,1689084553537 in 203 msec 2023-07-11 14:10:42,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-07-11 14:10:42,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, UNASSIGN in 216 msec 2023-07-11 14:10:42,864 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084642864"}]},"ts":"1689084642864"} 2023-07-11 14:10:42,865 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-07-11 14:10:42,867 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-07-11 14:10:42,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 239 msec 2023-07-11 14:10:42,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:42,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-11 14:10:42,943 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-07-11 14:10:42,955 INFO [Listener at localhost/44533] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:42,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 14:10:42,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689084642956 (current time:1689084642956). 2023-07-11 14:10:42,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 14:10:42,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] zookeeper.ReadOnlyZKClient(139): Connect 0x33950ac3 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:42,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a69e813, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:42,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:42,965 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:42,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33950ac3 to 127.0.0.1:63702 2023-07-11 14:10:42,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:42,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 14:10:42,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 14:10:42,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 14:10:42,969 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 14:10:42,970 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1689085242970 2023-07-11 14:10:42,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 14:10:42,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1689084633340-1689084642955 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-07-11 14:10:42,971 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:42,971 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 14:10:43,071 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:43,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:43,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:43,072 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 14:10:43,272 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:43,274 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 14:10:43,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 14:10:43,379 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/6835066dac06455ea1af9e8010042914] hfiles 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_ 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/6835066dac06455ea1af9e8010042914 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711b2750a80afc341c088f77558eba56629, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307113efee98c2c2848b6b0dd21a8dcb941df, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307112dfb156269104fcaa7e352b22d5b9ee3] hfiles 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711b2750a80afc341c088f77558eba56629 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307113efee98c2c2848b6b0dd21a8dcb941df 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307112dfb156269104fcaa7e352b22d5b9ee3 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d2ebb70b6f1846eab96cb8a9bb58d2b6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_] hfiles 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d2ebb70b6f1846eab96cb8a9bb58d2b6 2023-07-11 14:10:43,384 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_ 2023-07-11 14:10:43,385 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/ea7ad07deb194790a6f97c2cdc7ce973] hfiles 2023-07-11 14:10:43,385 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/ea7ad07deb194790a6f97c2cdc7ce973 2023-07-11 14:10:43,385 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/6a378b59437b4b629c6f6ee123e2a9c6] hfiles 2023-07-11 14:10:43,385 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/6a378b59437b4b629c6f6ee123e2a9c6 2023-07-11 14:10:43,387 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c6ef8add5b1e41768265e240eb975461, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_] hfiles 2023-07-11 14:10:43,387 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c6ef8add5b1e41768265e240eb975461 2023-07-11 14:10:43,387 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_ 2023-07-11 14:10:43,388 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/865b117766444774b836fe654cad3073] hfiles 2023-07-11 14:10:43,388 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/865b117766444774b836fe654cad3073 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711054d24ed956e48e89e9ee9b0377d3d47_del, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307111ec2f425338d4868b06c7c4daf329b49, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071123885ebe3d424c52ad9e3187dc12bc8c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711a46ff656a2ed40c9b5ab0cc258fc16bb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711c987cf9f18f14bdcba80b2ab069ecb2a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711100d076514254c3391a2cdada2d53a62, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307113cfdbb7c4ef245c69bb4c82a7f7a012f_del, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711466a7daa1f5d4e66bcfb2efc0c76e4f7, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711e0bd76febc8348b8bb99237356687e8d, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711f58190c531e344c786a62c5644675e27, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111a9619a363354a0081a1e3e73948d317, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071149c4def362c445f1853a4949ee962fdb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071155f466e7ea2b4970b9a3194c13dc4306_del, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071189b74e74620c46e593d6f64928aeee82, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711cee4c23c3fbe4fcf859606b43340cd1d] hfiles 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711054d24ed956e48e89e9ee9b0377d3d47_del 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307111ec2f425338d4868b06c7c4daf329b49 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071123885ebe3d424c52ad9e3187dc12bc8c 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711a46ff656a2ed40c9b5ab0cc258fc16bb 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711c987cf9f18f14bdcba80b2ab069ecb2a 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711100d076514254c3391a2cdada2d53a62 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307113cfdbb7c4ef245c69bb4c82a7f7a012f_del 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711466a7daa1f5d4e66bcfb2efc0c76e4f7 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711e0bd76febc8348b8bb99237356687e8d 2023-07-11 14:10:43,393 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711f58190c531e344c786a62c5644675e27 2023-07-11 14:10:43,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111a9619a363354a0081a1e3e73948d317 2023-07-11 14:10:43,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071149c4def362c445f1853a4949ee962fdb 2023-07-11 14:10:43,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071155f466e7ea2b4970b9a3194c13dc4306_del 2023-07-11 14:10:43,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071189b74e74620c46e593d6f64928aeee82 2023-07-11 14:10:43,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711cee4c23c3fbe4fcf859606b43340cd1d 2023-07-11 14:10:43,574 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:43,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:43,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:43,575 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 14:10:43,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-07-11 14:10:43,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:43,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:44,075 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:44,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:44,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 14:10:44,076 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 14:10:44,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689084633340-1689084642955 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:44,298 WARN [DataStreamer for file /user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/hbase-failsafe-snaptb-1689084633340-1689084642955/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 14:10:44,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1689084633340-1689084642955 of table testCompactionWithHFileLink completed 2023-07-11 14:10:44,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:44,714 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:44,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1689084633340-1689084642955 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1689084642970Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1689084643377 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1689084633340-1689084642955 at 1689084643794 (+417 ms)Loading Region manifests for hbase-failsafe-snaptb-1689084633340-1689084642955 at 1689084643794Writing data manifest for hbase-failsafe-snaptb-1689084633340-1689084642955 at 1689084643797 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1689084633340-1689084642955 at 1689084644234 (+437 ms)Snapshot hbase-failsafe-snaptb-1689084633340-1689084642955 of table testCompactionWithHFileLink completed at 1689084644713 (+479 ms) 2023-07-11 14:10:44,715 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 14:10:44,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.7470 sec 2023-07-11 14:10:45,077 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 14:10:45,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 14:10:45,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1689084633340-1689084642955 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 14:10:45,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1689084633340" table: "testCompactionWithHFileLink" creation_time: 1689084633354 type: FLUSH version: 2 ttl: 0 ) 2023-07-11 14:10:45,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1689084633340 as table=testCompactionWithHFileLink 2023-07-11 14:10:45,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 14:10:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 14:10:45,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 14:10:45,584 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:45,585 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:45,585 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-07-11 14:10:45,586 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 14:10:45,592 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1689084633340" table: "testCompactionWithHFileLink" creation_time: 1689084633354 type: FLUSH version: 2 ttl: 0 2023-07-11 14:10:45,593 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink 2023-07-11 14:10:45,600 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-07-11 14:10:45,611 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711b2750a80afc341c088f77558eba56629 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711b2750a80afc341c088f77558eba56629 2023-07-11 14:10:45,613 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307113efee98c2c2848b6b0dd21a8dcb941df to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307113efee98c2c2848b6b0dd21a8dcb941df 2023-07-11 14:10:45,615 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307112dfb156269104fcaa7e352b22d5b9ee3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307112dfb156269104fcaa7e352b22d5b9ee3 2023-07-11 14:10:45,615 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,630 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,642 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,658 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,668 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,674 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,682 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,687 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,694 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,701 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,717 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,723 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d of snapshot=snaptb-1689084633340 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 14:10:45,753 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307113cfdbb7c4ef245c69bb4c82a7f7a012f_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307113cfdbb7c4ef245c69bb4c82a7f7a012f_del 2023-07-11 14:10:45,756 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071155f466e7ea2b4970b9a3194c13dc4306_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023071155f466e7ea2b4970b9a3194c13dc4306_del 2023-07-11 14:10:45,767 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711054d24ed956e48e89e9ee9b0377d3d47_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711054d24ed956e48e89e9ee9b0377d3d47_del 2023-07-11 14:10:45,767 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:45,767 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:45,767 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:45,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 14:10:45,795 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/3699d01d13fc4db8b781e8b846a13138_SeqId_29_ 2023-07-11 14:10:45,797 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/6835066dac06455ea1af9e8010042914 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/6835066dac06455ea1af9e8010042914 2023-07-11 14:10:45,797 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3bd3a528948b4b2a979f08e87c07609a of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,798 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d2ebb70b6f1846eab96cb8a9bb58d2b6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d2ebb70b6f1846eab96cb8a9bb58d2b6 2023-07-11 14:10:45,801 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d9c174a4650548309585a192990d232c_SeqId_29_ 2023-07-11 14:10:45,801 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9d1c5c1cc3d143caa968fe72bf590213 of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,807 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c6ef8add5b1e41768265e240eb975461 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/c6ef8add5b1e41768265e240eb975461 2023-07-11 14:10:45,809 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/d3e15ea477fe4b2b8240569f04253344_SeqId_29_ 2023-07-11 14:10:45,809 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ed037c7fa5b744f2986a00d577d352fb of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,825 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b5721087d2754ac89cf73a45339403c1 of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,826 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 87934dd23a9541408f5005f4ad5baf8c of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,827 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7c4031e09a9c472e8231631adaeca156 of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,830 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e4a5ab29f5054cc39ca35b54d808db5b of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,830 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 78ddc0f18926451b8d22d3879cd4abae of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,840 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 27e5531119bb4764add0330a9c25ea0a of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,850 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 43ed1d1baffe40f29cd4ae64c7c87857 of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,851 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2d65d572ca3a4e9b99810ded67bc9399 of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,856 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a050038d656443f99802915606bd3710 of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,880 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/6a378b59437b4b629c6f6ee123e2a9c6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/6a378b59437b4b629c6f6ee123e2a9c6 2023-07-11 14:10:45,880 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1aeebd8cda414df8be74302f75ed1c85 of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,880 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/865b117766444774b836fe654cad3073 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/865b117766444774b836fe654cad3073 2023-07-11 14:10:45,880 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fd25f1f516544790a81c98b7784c49e8 of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,889 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 087c9ce23e54459a8dd9852bce4f1a8f of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,890 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/ea7ad07deb194790a6f97c2cdc7ce973 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/ea7ad07deb194790a6f97c2cdc7ce973 2023-07-11 14:10:45,890 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 37653409f4b34c9db5f325ee9a4987b0 of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,891 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d149fdc4364b4631891d3333258f5290 of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,908 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9d7adc16d81f478494f21276b7021abe of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,918 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 270804cab88943debd5680faf46e9c7b of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,922 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 69d549fbed334684890ca913703bae1a of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,922 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cb828fff040046279bc2780823d9e649 of snapshot=snaptb-1689084633340 to region=7b4c3e810294b74f730a671a9718e5b5 table=testCompactionWithHFileLink 2023-07-11 14:10:45,934 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 63f4146d55e74f5399636a6250597c92 of snapshot=snaptb-1689084633340 to region=d1dffee09ccc83fe54e67efb91e2730a table=testCompactionWithHFileLink 2023-07-11 14:10:45,934 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9e3a84cc98e7437ba0993261023412e4 of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,946 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a6b9d38f77ca4131b91956061470e1b9 of snapshot=snaptb-1689084633340 to region=9aaa666cabc8359a75b55d380a2e4fac table=testCompactionWithHFileLink 2023-07-11 14:10:45,950 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1689084633340" table: "testCompactionWithHFileLink" creation_time: 1689084633354 type: FLUSH version: 2 ttl: 0 2023-07-11 14:10:45,951 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689084645951"}]},"ts":"9223372036854775807"} 2023-07-11 14:10:45,952 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689084645951"}]},"ts":"9223372036854775807"} 2023-07-11 14:10:45,952 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689084645951"}]},"ts":"9223372036854775807"} 2023-07-11 14:10:45,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-11 14:10:45,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7b4c3e810294b74f730a671a9718e5b5, NAME => 'testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 9aaa666cabc8359a75b55d380a2e4fac, NAME => 'testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d1dffee09ccc83fe54e67efb91e2730a, NAME => 'testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.', STARTKEY => '2', ENDKEY => ''}] 2023-07-11 14:10:45,956 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084645952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084645952"}]},"ts":"1689084645952"} 2023-07-11 14:10:45,956 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084645952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084645952"}]},"ts":"1689084645952"} 2023-07-11 14:10:45,956 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084645952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084645952"}]},"ts":"1689084645952"} 2023-07-11 14:10:45,958 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 14:10:45,958 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-07-11 14:10:45,958 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 7b4c3e810294b74f730a671a9718e5b5, NAME => 'testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 9aaa666cabc8359a75b55d380a2e4fac, NAME => 'testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d1dffee09ccc83fe54e67efb91e2730a, NAME => 'testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.', STARTKEY => '2', ENDKEY => ''}] 2023-07-11 14:10:45,959 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1689084633340 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-07-11 14:10:45,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1689084633340" table: "testCompactionWithHFileLink" creation_time: 1689084633354 type: FLUSH version: 2 ttl: 0 ) in 825 msec 2023-07-11 14:10:46,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 14:10:46,275 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-07-11 14:10:46,275 INFO [Listener at localhost/44533] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:46,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "hbase-failsafe-snaptb-1689084633340-1689084642955" 2023-07-11 14:10:46,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1689084633340-1689084642955 2023-07-11 14:10:46,288 INFO [Listener at localhost/44533] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-07-11 14:10:46,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$10(2385): Client=jenkins//172.31.2.10 enable testCompactionWithHFileLink 2023-07-11 14:10:46,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-07-11 14:10:46,305 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-07-11 14:10:46,306 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084646305"}]},"ts":"1689084646305"} 2023-07-11 14:10:46,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 14:10:46,307 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-07-11 14:10:46,309 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-07-11 14:10:46,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN}] 2023-07-11 14:10:46,311 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN 2023-07-11 14:10:46,311 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN 2023-07-11 14:10:46,312 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-11 14:10:46,313 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-11 14:10:46,314 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN 2023-07-11 14:10:46,322 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-11 14:10:46,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 14:10:46,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=7b4c3e810294b74f730a671a9718e5b5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:46,465 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084646465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084646465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084646465"}]},"ts":"1689084646465"} 2023-07-11 14:10:46,465 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=d1dffee09ccc83fe54e67efb91e2730a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:46,465 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=9aaa666cabc8359a75b55d380a2e4fac, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:46,465 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084646465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084646465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084646465"}]},"ts":"1689084646465"} 2023-07-11 14:10:46,466 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084646465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084646465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084646465"}]},"ts":"1689084646465"} 2023-07-11 14:10:46,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 7b4c3e810294b74f730a671a9718e5b5, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:46,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure d1dffee09ccc83fe54e67efb91e2730a, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:46,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 9aaa666cabc8359a75b55d380a2e4fac, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:46,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 14:10:46,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:46,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1dffee09ccc83fe54e67efb91e2730a, NAME => 'testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 14:10:46,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:46,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,627 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,628 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:46,628 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:46,628 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1dffee09ccc83fe54e67efb91e2730a columnFamilyName family1 2023-07-11 14:10:46,646 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-27e5531119bb4764add0330a9c25ea0a 2023-07-11 14:10:46,671 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-7c4031e09a9c472e8231631adaeca156 2023-07-11 14:10:46,682 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-9d1c5c1cc3d143caa968fe72bf590213 2023-07-11 14:10:46,692 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-a050038d656443f99802915606bd3710 2023-07-11 14:10:46,692 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(310): Store=d1dffee09ccc83fe54e67efb91e2730a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:46,692 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,694 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2 2023-07-11 14:10:46,694 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2 2023-07-11 14:10:46,694 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1dffee09ccc83fe54e67efb91e2730a columnFamilyName family2 2023-07-11 14:10:46,704 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-087c9ce23e54459a8dd9852bce4f1a8f 2023-07-11 14:10:46,711 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-1aeebd8cda414df8be74302f75ed1c85 2023-07-11 14:10:46,730 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-63f4146d55e74f5399636a6250597c92 2023-07-11 14:10:46,750 DEBUG [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-69d549fbed334684890ca913703bae1a 2023-07-11 14:10:46,750 INFO [StoreOpener-d1dffee09ccc83fe54e67efb91e2730a-1] regionserver.HStore(310): Store=d1dffee09ccc83fe54e67efb91e2730a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:46,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:46,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:10:46,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d1dffee09ccc83fe54e67efb91e2730a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74578035, jitterRate=0.11129932105541229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:46,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:46,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a., pid=102, masterSystemTime=1689084646621 2023-07-11 14:10:46,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:46,759 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 14:10:46,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 14:10:46,759 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 14:10:46,761 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=d1dffee09ccc83fe54e67efb91e2730a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:46,761 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084646761"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084646761"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084646761"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084646761"}]},"ts":"1689084646761"} 2023-07-11 14:10:46,763 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 14:10:46,764 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1912): d1dffee09ccc83fe54e67efb91e2730a/family2 is initiating minor compaction (all files) 2023-07-11 14:10:46,764 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegion(2259): Starting compaction of d1dffee09ccc83fe54e67efb91e2730a/family2 in testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:46,764 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-1aeebd8cda414df8be74302f75ed1c85, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-087c9ce23e54459a8dd9852bce4f1a8f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-69d549fbed334684890ca913703bae1a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-63f4146d55e74f5399636a6250597c92] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp, totalSize=20.4 K 2023-07-11 14:10:46,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:46,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:46,764 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 14:10:46,764 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1912): d1dffee09ccc83fe54e67efb91e2730a/family1 is initiating minor compaction (all files) 2023-07-11 14:10:46,764 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d1dffee09ccc83fe54e67efb91e2730a/family1 in testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:10:46,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-11 14:10:46,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure d1dffee09ccc83fe54e67efb91e2730a, server=jenkins-hbase9.apache.org,46743,1689084553537 in 295 msec 2023-07-11 14:10:46,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:46,764 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-9d1c5c1cc3d143caa968fe72bf590213, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-7c4031e09a9c472e8231631adaeca156, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-27e5531119bb4764add0330a9c25ea0a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-a050038d656443f99802915606bd3710] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp, totalSize=21.6 K 2023-07-11 14:10:46,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9aaa666cabc8359a75b55d380a2e4fac, NAME => 'testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 14:10:46,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:46,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:46,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:46,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:46,766 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-9d1c5c1cc3d143caa968fe72bf590213, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:46,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d1dffee09ccc83fe54e67efb91e2730a, ASSIGN in 456 msec 2023-07-11 14:10:46,767 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-7c4031e09a9c472e8231631adaeca156, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:46,768 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-1aeebd8cda414df8be74302f75ed1c85, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:46,770 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-27e5531119bb4764add0330a9c25ea0a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:46,770 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:46,771 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-087c9ce23e54459a8dd9852bce4f1a8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:46,772 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:46,772 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:46,773 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-69d549fbed334684890ca913703bae1a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:46,773 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-a050038d656443f99802915606bd3710, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:46,775 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aaa666cabc8359a75b55d380a2e4fac columnFamilyName family1 2023-07-11 14:10:46,779 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-63f4146d55e74f5399636a6250597c92, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:46,817 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-2d65d572ca3a4e9b99810ded67bc9399 2023-07-11 14:10:46,835 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-3bd3a528948b4b2a979f08e87c07609a 2023-07-11 14:10:46,857 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] throttle.PressureAwareThroughputController(145): d1dffee09ccc83fe54e67efb91e2730a#family2#compaction#114 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:46,858 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): d1dffee09ccc83fe54e67efb91e2730a#family1#compaction#115 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:46,887 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-b5721087d2754ac89cf73a45339403c1 2023-07-11 14:10:46,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 14:10:46,917 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-e4a5ab29f5054cc39ca35b54d808db5b 2023-07-11 14:10:46,922 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(310): Store=9aaa666cabc8359a75b55d380a2e4fac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:46,922 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:46,924 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2 2023-07-11 14:10:46,924 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2 2023-07-11 14:10:46,924 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aaa666cabc8359a75b55d380a2e4fac columnFamilyName family2 2023-07-11 14:10:46,941 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-270804cab88943debd5680faf46e9c7b 2023-07-11 14:10:46,968 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-37653409f4b34c9db5f325ee9a4987b0 2023-07-11 14:10:46,974 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-9e3a84cc98e7437ba0993261023412e4 2023-07-11 14:10:46,992 DEBUG [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-a6b9d38f77ca4131b91956061470e1b9 2023-07-11 14:10:46,992 INFO [StoreOpener-9aaa666cabc8359a75b55d380a2e4fac-1] regionserver.HStore(310): Store=9aaa666cabc8359a75b55d380a2e4fac/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:46,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:46,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:46,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:46,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:10:47,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9aaa666cabc8359a75b55d380a2e4fac; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63330006, jitterRate=-0.05630937218666077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:47,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:47,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac., pid=103, masterSystemTime=1689084646621 2023-07-11 14:10:47,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 14:10:47,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-07-11 14:10:47,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:47,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:47,003 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=9aaa666cabc8359a75b55d380a2e4fac, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:47,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:47,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b4c3e810294b74f730a671a9718e5b5, NAME => 'testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 14:10:47,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:47,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,003 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689084647003"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084647003"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084647003"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084647003"}]},"ts":"1689084647003"} 2023-07-11 14:10:47,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-07-11 14:10:47,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 9aaa666cabc8359a75b55d380a2e4fac, server=jenkins-hbase9.apache.org,46743,1689084553537 in 536 msec 2023-07-11 14:10:47,010 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aaa666cabc8359a75b55d380a2e4fac, ASSIGN in 700 msec 2023-07-11 14:10:47,011 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:47,011 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:47,011 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b4c3e810294b74f730a671a9718e5b5 columnFamilyName family1 2023-07-11 14:10:47,033 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-43ed1d1baffe40f29cd4ae64c7c87857 2023-07-11 14:10:47,055 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-78ddc0f18926451b8d22d3879cd4abae 2023-07-11 14:10:47,072 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-87934dd23a9541408f5005f4ad5baf8c 2023-07-11 14:10:47,082 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-ed037c7fa5b744f2986a00d577d352fb 2023-07-11 14:10:47,083 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(310): Store=7b4c3e810294b74f730a671a9718e5b5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:47,083 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,084 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2 2023-07-11 14:10:47,084 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2 2023-07-11 14:10:47,084 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b4c3e810294b74f730a671a9718e5b5 columnFamilyName family2 2023-07-11 14:10:47,102 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-9d7adc16d81f478494f21276b7021abe 2023-07-11 14:10:47,114 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-cb828fff040046279bc2780823d9e649 2023-07-11 14:10:47,128 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-d149fdc4364b4631891d3333258f5290 2023-07-11 14:10:47,135 DEBUG [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(539): loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-fd25f1f516544790a81c98b7784c49e8 2023-07-11 14:10:47,135 INFO [StoreOpener-7b4c3e810294b74f730a671a9718e5b5-1] regionserver.HStore(310): Store=7b4c3e810294b74f730a671a9718e5b5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:47,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:47,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:10:47,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7b4c3e810294b74f730a671a9718e5b5; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64164906, jitterRate=-0.04386839270591736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:47,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:47,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5., pid=101, masterSystemTime=1689084646621 2023-07-11 14:10:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 14:10:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-07-11 14:10:47,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:47,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:47,143 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=7b4c3e810294b74f730a671a9718e5b5, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:47,143 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084647142"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084647142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084647142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084647142"}]},"ts":"1689084647142"} 2023-07-11 14:10:47,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-11 14:10:47,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 7b4c3e810294b74f730a671a9718e5b5, server=jenkins-hbase9.apache.org,46743,1689084553537 in 676 msec 2023-07-11 14:10:47,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-07-11 14:10:47,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7b4c3e810294b74f730a671a9718e5b5, ASSIGN in 836 msec 2023-07-11 14:10:47,147 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084647147"}]},"ts":"1689084647147"} 2023-07-11 14:10:47,148 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-07-11 14:10:47,150 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-07-11 14:10:47,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 854 msec 2023-07-11 14:10:47,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 14:10:47,414 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-07-11 14:10:47,432 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:47,443 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:47,457 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:47,466 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:47,476 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 14:10:47,502 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-07-11 14:10:47,502 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:47,502 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(139): Connect 0x386c05d0 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:10:47,514 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18822f8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:10:47,514 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:47,514 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:47,514 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:47,669 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711bcdbdae822b545da8662763d4b32b54a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711bcdbdae822b545da8662763d4b32b54a 2023-07-11 14:10:47,670 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:47,685 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:10:47,691 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:10:47,700 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:10:47,704 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:10:47,726 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/712d441567f1434a9b5aa726eb77a816 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-07-11 14:10:47,735 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/712d441567f1434a9b5aa726eb77a816}] 2023-07-11 14:10:47,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/712d441567f1434a9b5aa726eb77a816 for inclusion in 7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:47,760 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family2/9b38af610b894ced87f6dbdcbc72d14e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/9b38af610b894ced87f6dbdcbc72d14e 2023-07-11 14:10:47,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-07-11 14:10:47,771 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/.tmp/family1/1f3dfa1642f140f5a70188d7e9ced299 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/1f3dfa1642f140f5a70188d7e9ced299 2023-07-11 14:10:47,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 14:10:47,772 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-07-11 14:10:47,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:47,773 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d1dffee09ccc83fe54e67efb91e2730a/family2 of d1dffee09ccc83fe54e67efb91e2730a into 9b38af610b894ced87f6dbdcbc72d14e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 14:10:47,773 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:47,773 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a., storeName=d1dffee09ccc83fe54e67efb91e2730a/family2, priority=12, startTime=1689084646759; duration=1sec 2023-07-11 14:10:47,773 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-07-11 14:10:47,774 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 14:10:47,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/712d441567f1434a9b5aa726eb77a816 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__3g0oatloes6rno0eeflo8rtb5jrpov20juj1gibf5dsrmop2tmtlteulh4ugcr2j/family1/712d441567f1434a9b5aa726eb77a816 2023-07-11 14:10:47,781 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 14:10:47,782 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d1dffee09ccc83fe54e67efb91e2730a/family1 of d1dffee09ccc83fe54e67efb91e2730a into 1f3dfa1642f140f5a70188d7e9ced299(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 14:10:47,782 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:47,782 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a., storeName=d1dffee09ccc83fe54e67efb91e2730a/family1, priority=12, startTime=1689084646758; duration=1sec 2023-07-11 14:10:47,782 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 14:10:47,782 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 14:10:47,782 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1912): 9aaa666cabc8359a75b55d380a2e4fac/family1 is initiating minor compaction (all files) 2023-07-11 14:10:47,783 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9aaa666cabc8359a75b55d380a2e4fac/family1 in testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:47,783 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-3bd3a528948b4b2a979f08e87c07609a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-b5721087d2754ac89cf73a45339403c1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-e4a5ab29f5054cc39ca35b54d808db5b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-2d65d572ca3a4e9b99810ded67bc9399] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp, totalSize=21.6 K 2023-07-11 14:10:47,784 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-3bd3a528948b4b2a979f08e87c07609a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628013 2023-07-11 14:10:47,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__3g0oatloes6rno0eeflo8rtb5jrpov20juj1gibf5dsrmop2tmtlteulh4ugcr2j/family1/712d441567f1434a9b5aa726eb77a816 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_ 2023-07-11 14:10:47,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__3g0oatloes6rno0eeflo8rtb5jrpov20juj1gibf5dsrmop2tmtlteulh4ugcr2j/family1/712d441567f1434a9b5aa726eb77a816 into 7b4c3e810294b74f730a671a9718e5b5/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_ - updating store file list. 2023-07-11 14:10:47,785 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-b5721087d2754ac89cf73a45339403c1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:47,785 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 14:10:47,785 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1912): 7b4c3e810294b74f730a671a9718e5b5/family2 is initiating minor compaction (all files) 2023-07-11 14:10:47,785 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7b4c3e810294b74f730a671a9718e5b5/family2 in testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:47,786 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-fd25f1f516544790a81c98b7784c49e8, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-d149fdc4364b4631891d3333258f5290, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-9d7adc16d81f478494f21276b7021abe, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-cb828fff040046279bc2780823d9e649] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp, totalSize=20.4 K 2023-07-11 14:10:47,788 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-e4a5ab29f5054cc39ca35b54d808db5b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630328 2023-07-11 14:10:47,789 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-fd25f1f516544790a81c98b7784c49e8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:47,790 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-2d65d572ca3a4e9b99810ded67bc9399, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631791 2023-07-11 14:10:47,790 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-d149fdc4364b4631891d3333258f5290, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:47,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_ into 7b4c3e810294b74f730a671a9718e5b5/family1 2023-07-11 14:10:47,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__3g0oatloes6rno0eeflo8rtb5jrpov20juj1gibf5dsrmop2tmtlteulh4ugcr2j/family1/712d441567f1434a9b5aa726eb77a816 into 7b4c3e810294b74f730a671a9718e5b5/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_) 2023-07-11 14:10:47,794 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-9d7adc16d81f478494f21276b7021abe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:47,795 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-cb828fff040046279bc2780823d9e649, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:47,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__3g0oatloes6rno0eeflo8rtb5jrpov20juj1gibf5dsrmop2tmtlteulh4ugcr2j/family1/712d441567f1434a9b5aa726eb77a816 2023-07-11 14:10:47,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:47,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-9d1c5c1cc3d143caa968fe72bf590213, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-7c4031e09a9c472e8231631adaeca156, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-27e5531119bb4764add0330a9c25ea0a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-a050038d656443f99802915606bd3710] to archive 2023-07-11 14:10:47,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:47,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-07-11 14:10:47,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): 7b4c3e810294b74f730a671a9718e5b5/family1 is initiating minor compaction (all files) 2023-07-11 14:10:47,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c80cb39; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 14:10:47,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-9d1c5c1cc3d143caa968fe72bf590213 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-9d1c5c1cc3d143caa968fe72bf590213 2023-07-11 14:10:47,813 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:47,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-7c4031e09a9c472e8231631adaeca156 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-7c4031e09a9c472e8231631adaeca156 2023-07-11 14:10:47,814 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:47,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-27e5531119bb4764add0330a9c25ea0a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-27e5531119bb4764add0330a9c25ea0a 2023-07-11 14:10:47,816 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711021d6b9007ff444f95e344aef9ef2b62 2023-07-11 14:10:47,817 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023071104e51ec2c9494d888cc9cea90fdb7b96 2023-07-11 14:10:47,829 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202307111be567cdac4d4f039f0a543386f5689a 2023-07-11 14:10:47,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-a050038d656443f99802915606bd3710 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-a050038d656443f99802915606bd3710 2023-07-11 14:10:47,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-1aeebd8cda414df8be74302f75ed1c85, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-087c9ce23e54459a8dd9852bce4f1a8f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-69d549fbed334684890ca913703bae1a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-63f4146d55e74f5399636a6250597c92] to archive 2023-07-11 14:10:47,832 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711c774046a7b264e9c8a6536520c21959e 2023-07-11 14:10:47,832 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 14:10:47,832 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 14:10:47,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:47,833 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:47,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-1aeebd8cda414df8be74302f75ed1c85 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-1aeebd8cda414df8be74302f75ed1c85 2023-07-11 14:10:47,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-087c9ce23e54459a8dd9852bce4f1a8f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-087c9ce23e54459a8dd9852bce4f1a8f 2023-07-11 14:10:47,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-69d549fbed334684890ca913703bae1a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-69d549fbed334684890ca913703bae1a 2023-07-11 14:10:47,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-63f4146d55e74f5399636a6250597c92 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family2/testCompactionWithHFileLink=d1dffee09ccc83fe54e67efb91e2730a-63f4146d55e74f5399636a6250597c92 2023-07-11 14:10:47,852 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] throttle.PressureAwareThroughputController(145): 9aaa666cabc8359a75b55d380a2e4fac#family1#compaction#116 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:47,853 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7b4c3e810294b74f730a671a9718e5b5#family2#compaction#117 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:48,041 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711bc855caaf4f14793ac1ae13bc1697282 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711bc855caaf4f14793ac1ae13bc1697282 2023-07-11 14:10:48,042 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:48,067 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711df9cf3f0c75640bf8f5c01872963c5c8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711df9cf3f0c75640bf8f5c01872963c5c8 2023-07-11 14:10:48,068 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:48,074 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/d61bfa1172d84758b2c8409c68ff6515 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-07-11 14:10:48,075 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=32 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/d61bfa1172d84758b2c8409c68ff6515}] 2023-07-11 14:10:48,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/d61bfa1172d84758b2c8409c68ff6515 for inclusion in 9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:48,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-07-11 14:10:48,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 14:10:48,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:48,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/d61bfa1172d84758b2c8409c68ff6515 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__idbu25u441v0spl9d51t5v8j3nplm0a4qgjbv7iaf1821nmom5o5jreiprnq6uri/family1/d61bfa1172d84758b2c8409c68ff6515 2023-07-11 14:10:48,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__idbu25u441v0spl9d51t5v8j3nplm0a4qgjbv7iaf1821nmom5o5jreiprnq6uri/family1/d61bfa1172d84758b2c8409c68ff6515 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/9eec6604ebd649cd90ebbcbc398e7819_SeqId_34_ 2023-07-11 14:10:48,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__idbu25u441v0spl9d51t5v8j3nplm0a4qgjbv7iaf1821nmom5o5jreiprnq6uri/family1/d61bfa1172d84758b2c8409c68ff6515 into 9aaa666cabc8359a75b55d380a2e4fac/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/9eec6604ebd649cd90ebbcbc398e7819_SeqId_34_ - updating store file list. 2023-07-11 14:10:48,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/9eec6604ebd649cd90ebbcbc398e7819_SeqId_34_ into 9aaa666cabc8359a75b55d380a2e4fac/family1 2023-07-11 14:10:48,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__idbu25u441v0spl9d51t5v8j3nplm0a4qgjbv7iaf1821nmom5o5jreiprnq6uri/family1/d61bfa1172d84758b2c8409c68ff6515 into 9aaa666cabc8359a75b55d380a2e4fac/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/9eec6604ebd649cd90ebbcbc398e7819_SeqId_34_) 2023-07-11 14:10:48,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__idbu25u441v0spl9d51t5v8j3nplm0a4qgjbv7iaf1821nmom5o5jreiprnq6uri/family1/d61bfa1172d84758b2c8409c68ff6515 2023-07-11 14:10:48,109 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:48,111 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:48,113 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307113071d14d41c442bca475ee1b7c516812 2023-07-11 14:10:48,115 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307114a48ec12b8f94f02ad92f96c0db93cd5 2023-07-11 14:10:48,117 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023071187c13d13ed734b3d8d54fd6ab98ffe9b 2023-07-11 14:10:48,118 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230711f95829162c48466e8a155accaf04595d 2023-07-11 14:10:48,118 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 14:10:48,118 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 14:10:48,118 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:48,141 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/211ba1d5d0a74296bb2cfc76ef87465e first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-07-11 14:10:48,142 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/211ba1d5d0a74296bb2cfc76ef87465e}] 2023-07-11 14:10:48,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/211ba1d5d0a74296bb2cfc76ef87465e for inclusion in d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:48,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-07-11 14:10:48,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 14:10:48,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:10:48,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/211ba1d5d0a74296bb2cfc76ef87465e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__si3iddm0vafru7k79gsge1pu2088a338docorsq1k4qmtmq0r5m62k64442trd5g/family1/211ba1d5d0a74296bb2cfc76ef87465e 2023-07-11 14:10:48,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__si3iddm0vafru7k79gsge1pu2088a338docorsq1k4qmtmq0r5m62k64442trd5g/family1/211ba1d5d0a74296bb2cfc76ef87465e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d949a1c253254ae4818de2d84db0ee72_SeqId_36_ 2023-07-11 14:10:48,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__si3iddm0vafru7k79gsge1pu2088a338docorsq1k4qmtmq0r5m62k64442trd5g/family1/211ba1d5d0a74296bb2cfc76ef87465e into d1dffee09ccc83fe54e67efb91e2730a/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d949a1c253254ae4818de2d84db0ee72_SeqId_36_ - updating store file list. 2023-07-11 14:10:48,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d949a1c253254ae4818de2d84db0ee72_SeqId_36_ into d1dffee09ccc83fe54e67efb91e2730a/family1 2023-07-11 14:10:48,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__si3iddm0vafru7k79gsge1pu2088a338docorsq1k4qmtmq0r5m62k64442trd5g/family1/211ba1d5d0a74296bb2cfc76ef87465e into d1dffee09ccc83fe54e67efb91e2730a/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/family1/d949a1c253254ae4818de2d84db0ee72_SeqId_36_) 2023-07-11 14:10:48,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testCompactionWithHFileLink__si3iddm0vafru7k79gsge1pu2088a338docorsq1k4qmtmq0r5m62k64442trd5g/family1/211ba1d5d0a74296bb2cfc76ef87465e 2023-07-11 14:10:48,169 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:48,171 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:48,172 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307115759465f803f47cfbbef041bc703f0a2 2023-07-11 14:10:48,174 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202307119a5edef749e64658bc395c2e78409872 2023-07-11 14:10:48,175 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711d6ed1903a442410c9bf8f0c27a898ea0 2023-07-11 14:10:48,177 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711e455509e8b0049639ddc806730d15c5d 2023-07-11 14:10:48,178 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 14:10:48,178 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 14:10:48,178 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 14:10:48,178 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 14:10:48,185 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:48,187 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:48,194 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:48,195 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:48,203 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:48,204 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:48,226 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 253) - Thread LEAK? -, OpenFileDescriptor=738 (was 632) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=625 (was 615) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=642 (was 1232) 2023-07-11 14:10:48,243 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=738, MaxFileDescriptor=60000, SystemLoadAverage=625, ProcessCount=181, AvailableMemoryMB=624 2023-07-11 14:10:48,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$15(3014): Client=jenkins//172.31.2.10 creating {NAME => 'ns'} 2023-07-11 14:10:48,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-07-11 14:10:48,265 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 14:10:48,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 14:10:48,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 11 msec 2023-07-11 14:10:48,297 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family2/33b48d021dd84cd49f6598724820a31e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/33b48d021dd84cd49f6598724820a31e 2023-07-11 14:10:48,302 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 7b4c3e810294b74f730a671a9718e5b5/family2 of 7b4c3e810294b74f730a671a9718e5b5 into 33b48d021dd84cd49f6598724820a31e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:48,302 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:48,302 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5., storeName=7b4c3e810294b74f730a671a9718e5b5/family2, priority=12, startTime=1689084647141; duration=0sec 2023-07-11 14:10:48,302 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 14:10:48,302 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7b4c3e810294b74f730a671a9718e5b5/family1 in testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:10:48,302 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-ed037c7fa5b744f2986a00d577d352fb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-87934dd23a9541408f5005f4ad5baf8c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-78ddc0f18926451b8d22d3879cd4abae, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-43ed1d1baffe40f29cd4ae64c7c87857, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp, totalSize=28.9 K 2023-07-11 14:10:48,303 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-ed037c7fa5b744f2986a00d577d352fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628015 2023-07-11 14:10:48,304 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-87934dd23a9541408f5005f4ad5baf8c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:48,305 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-78ddc0f18926451b8d22d3879cd4abae, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630329 2023-07-11 14:10:48,305 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-43ed1d1baffe40f29cd4ae64c7c87857, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631792 2023-07-11 14:10:48,306 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting a63c55be335d44fca3622e503b669277_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1689084628015 2023-07-11 14:10:48,343 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7b4c3e810294b74f730a671a9718e5b5#family1#compaction#118 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:48,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 14:10:48,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 14:10:48,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-07-11 14:10:48,370 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:10:48,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-07-11 14:10:48,371 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:10:48,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 14:10:48,372 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:10:48,373 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:48,373 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:48,375 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:48,375 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9 empty. 2023-07-11 14:10:48,376 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5 empty. 2023-07-11 14:10:48,376 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:48,376 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:48,376 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e empty. 2023-07-11 14:10:48,377 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:48,377 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-07-11 14:10:48,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-fd25f1f516544790a81c98b7784c49e8, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-d149fdc4364b4631891d3333258f5290, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-9d7adc16d81f478494f21276b7021abe, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-cb828fff040046279bc2780823d9e649] to archive 2023-07-11 14:10:48,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:48,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-fd25f1f516544790a81c98b7784c49e8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-fd25f1f516544790a81c98b7784c49e8 2023-07-11 14:10:48,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-d149fdc4364b4631891d3333258f5290 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-d149fdc4364b4631891d3333258f5290 2023-07-11 14:10:48,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-9d7adc16d81f478494f21276b7021abe to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-9d7adc16d81f478494f21276b7021abe 2023-07-11 14:10:48,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-cb828fff040046279bc2780823d9e649 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family2/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-cb828fff040046279bc2780823d9e649 2023-07-11 14:10:48,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 14:10:48,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 14:10:48,689 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family1/4301c186be1b453aacb7ddc65cb7aef3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/4301c186be1b453aacb7ddc65cb7aef3 2023-07-11 14:10:48,694 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9aaa666cabc8359a75b55d380a2e4fac/family1 of 9aaa666cabc8359a75b55d380a2e4fac into 4301c186be1b453aacb7ddc65cb7aef3(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:48,695 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:48,695 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac., storeName=9aaa666cabc8359a75b55d380a2e4fac/family1, priority=12, startTime=1689084647001; duration=0sec 2023-07-11 14:10:48,695 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-07-11 14:10:48,695 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-07-11 14:10:48,695 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-07-11 14:10:48,695 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-07-11 14:10:48,695 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. because compaction request was cancelled 2023-07-11 14:10:48,695 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 14:10:48,697 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 14:10:48,697 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1912): 9aaa666cabc8359a75b55d380a2e4fac/family2 is initiating minor compaction (all files) 2023-07-11 14:10:48,698 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9aaa666cabc8359a75b55d380a2e4fac/family2 in testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:10:48,698 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-37653409f4b34c9db5f325ee9a4987b0, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-270804cab88943debd5680faf46e9c7b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-9e3a84cc98e7437ba0993261023412e4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-a6b9d38f77ca4131b91956061470e1b9] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp, totalSize=20.4 K 2023-07-11 14:10:48,698 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-37653409f4b34c9db5f325ee9a4987b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084628013 2023-07-11 14:10:48,699 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-270804cab88943debd5680faf46e9c7b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084628777 2023-07-11 14:10:48,699 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-9e3a84cc98e7437ba0993261023412e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084630328 2023-07-11 14:10:48,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-3bd3a528948b4b2a979f08e87c07609a, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-b5721087d2754ac89cf73a45339403c1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-e4a5ab29f5054cc39ca35b54d808db5b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-2d65d572ca3a4e9b99810ded67bc9399] to archive 2023-07-11 14:10:48,700 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-a6b9d38f77ca4131b91956061470e1b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084631791 2023-07-11 14:10:48,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:48,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-3bd3a528948b4b2a979f08e87c07609a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-3bd3a528948b4b2a979f08e87c07609a 2023-07-11 14:10:48,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-b5721087d2754ac89cf73a45339403c1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-b5721087d2754ac89cf73a45339403c1 2023-07-11 14:10:48,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-e4a5ab29f5054cc39ca35b54d808db5b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-e4a5ab29f5054cc39ca35b54d808db5b 2023-07-11 14:10:48,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-2d65d572ca3a4e9b99810ded67bc9399 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family1/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-2d65d572ca3a4e9b99810ded67bc9399 2023-07-11 14:10:48,715 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] throttle.PressureAwareThroughputController(145): 9aaa666cabc8359a75b55d380a2e4fac#family2#compaction#119 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:48,791 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-07-11 14:10:48,792 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => bcf670488a25fe6c22291cd6aac15c1e, NAME => 'ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:48,792 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => daba5eabb4b40fdec155cf1e437895d9, NAME => 'ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:48,792 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => fa4ceb102d347183576477762c1978f5, NAME => 'ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:10:48,798 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:48,798 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing daba5eabb4b40fdec155cf1e437895d9, disabling compactions & flushes 2023-07-11 14:10:48,798 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:48,798 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:48,798 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. after waiting 0 ms 2023-07-11 14:10:48,798 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:48,798 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:48,798 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:48,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 14:10:49,163 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/.tmp/family1/ccde9241aba9441a95cb74fcc2d2f5ca as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/ccde9241aba9441a95cb74fcc2d2f5ca 2023-07-11 14:10:49,168 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 7b4c3e810294b74f730a671a9718e5b5/family1 of 7b4c3e810294b74f730a671a9718e5b5 into ccde9241aba9441a95cb74fcc2d2f5ca(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:49,169 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:10:49,169 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1689084647805; duration=0sec 2023-07-11 14:10:49,169 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:49,198 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:49,198 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing bcf670488a25fe6c22291cd6aac15c1e, disabling compactions & flushes 2023-07-11 14:10:49,198 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:49,198 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:49,198 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:49,199 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. after waiting 0 ms 2023-07-11 14:10:49,198 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing fa4ceb102d347183576477762c1978f5, disabling compactions & flushes 2023-07-11 14:10:49,199 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:49,199 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:49,199 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:49,199 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:49,199 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:49,199 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. after waiting 0 ms 2023-07-11 14:10:49,199 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:49,199 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:49,199 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:49,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-ed037c7fa5b744f2986a00d577d352fb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-87934dd23a9541408f5005f4ad5baf8c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-78ddc0f18926451b8d22d3879cd4abae, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-43ed1d1baffe40f29cd4ae64c7c87857, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_] to archive 2023-07-11 14:10:49,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:49,203 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:10:49,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-ed037c7fa5b744f2986a00d577d352fb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-ed037c7fa5b744f2986a00d577d352fb 2023-07-11 14:10:49,204 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689084649203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084649203"}]},"ts":"1689084649203"} 2023-07-11 14:10:49,204 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689084649203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084649203"}]},"ts":"1689084649203"} 2023-07-11 14:10:49,204 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689084649203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084649203"}]},"ts":"1689084649203"} 2023-07-11 14:10:49,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-87934dd23a9541408f5005f4ad5baf8c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-87934dd23a9541408f5005f4ad5baf8c 2023-07-11 14:10:49,206 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 14:10:49,207 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:10:49,207 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084649207"}]},"ts":"1689084649207"} 2023-07-11 14:10:49,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-78ddc0f18926451b8d22d3879cd4abae to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-78ddc0f18926451b8d22d3879cd4abae 2023-07-11 14:10:49,209 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-07-11 14:10:49,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-43ed1d1baffe40f29cd4ae64c7c87857 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/testCompactionWithHFileLink=7b4c3e810294b74f730a671a9718e5b5-43ed1d1baffe40f29cd4ae64c7c87857 2023-07-11 14:10:49,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/family1/a63c55be335d44fca3622e503b669277_SeqId_34_ 2023-07-11 14:10:49,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=daba5eabb4b40fdec155cf1e437895d9, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fa4ceb102d347183576477762c1978f5, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcf670488a25fe6c22291cd6aac15c1e, ASSIGN}] 2023-07-11 14:10:49,218 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcf670488a25fe6c22291cd6aac15c1e, ASSIGN 2023-07-11 14:10:49,218 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fa4ceb102d347183576477762c1978f5, ASSIGN 2023-07-11 14:10:49,218 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=daba5eabb4b40fdec155cf1e437895d9, ASSIGN 2023-07-11 14:10:49,219 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcf670488a25fe6c22291cd6aac15c1e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:49,219 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=daba5eabb4b40fdec155cf1e437895d9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:49,219 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fa4ceb102d347183576477762c1978f5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:10:49,372 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=daba5eabb4b40fdec155cf1e437895d9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:49,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fa4ceb102d347183576477762c1978f5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:49,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=bcf670488a25fe6c22291cd6aac15c1e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:49,372 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689084649372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084649372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084649372"}]},"ts":"1689084649372"} 2023-07-11 14:10:49,372 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689084649372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084649372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084649372"}]},"ts":"1689084649372"} 2023-07-11 14:10:49,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689084649372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084649372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084649372"}]},"ts":"1689084649372"} 2023-07-11 14:10:49,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure fa4ceb102d347183576477762c1978f5, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:49,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure daba5eabb4b40fdec155cf1e437895d9, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:49,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure bcf670488a25fe6c22291cd6aac15c1e, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:10:49,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 14:10:49,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:49,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa4ceb102d347183576477762c1978f5, NAME => 'ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 14:10:49,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:49,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,540 INFO [StoreOpener-fa4ceb102d347183576477762c1978f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,543 DEBUG [StoreOpener-fa4ceb102d347183576477762c1978f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1 2023-07-11 14:10:49,543 DEBUG [StoreOpener-fa4ceb102d347183576477762c1978f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1 2023-07-11 14:10:49,544 INFO [StoreOpener-fa4ceb102d347183576477762c1978f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa4ceb102d347183576477762c1978f5 columnFamilyName family1 2023-07-11 14:10:49,546 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/.tmp/family2/be0657fdbbe6439285ec36e5ed7543ec as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/be0657fdbbe6439285ec36e5ed7543ec 2023-07-11 14:10:49,546 INFO [StoreOpener-fa4ceb102d347183576477762c1978f5-1] regionserver.HStore(310): Store=fa4ceb102d347183576477762c1978f5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:49,547 INFO [StoreOpener-fa4ceb102d347183576477762c1978f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,548 DEBUG [StoreOpener-fa4ceb102d347183576477762c1978f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2 2023-07-11 14:10:49,548 DEBUG [StoreOpener-fa4ceb102d347183576477762c1978f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2 2023-07-11 14:10:49,549 INFO [StoreOpener-fa4ceb102d347183576477762c1978f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa4ceb102d347183576477762c1978f5 columnFamilyName family2 2023-07-11 14:10:49,553 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9aaa666cabc8359a75b55d380a2e4fac/family2 of 9aaa666cabc8359a75b55d380a2e4fac into be0657fdbbe6439285ec36e5ed7543ec(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:49,553 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:10:49,553 INFO [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac., storeName=9aaa666cabc8359a75b55d380a2e4fac/family2, priority=12, startTime=1689084647001; duration=0sec 2023-07-11 14:10:49,553 DEBUG [RS:0;jenkins-hbase9:46743-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:10:49,553 INFO [StoreOpener-fa4ceb102d347183576477762c1978f5-1] regionserver.HStore(310): Store=fa4ceb102d347183576477762c1978f5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:49,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:49,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for fa4ceb102d347183576477762c1978f5 2023-07-11 14:10:49,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:49,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened fa4ceb102d347183576477762c1978f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59841289, jitterRate=-0.10829530656337738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:49,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:49,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5., pid=109, masterSystemTime=1689084649529 2023-07-11 14:10:49,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:49,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:49,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:49,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => daba5eabb4b40fdec155cf1e437895d9, NAME => 'ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 14:10:49,562 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fa4ceb102d347183576477762c1978f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:49,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,562 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689084649562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084649562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084649562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084649562"}]},"ts":"1689084649562"} 2023-07-11 14:10:49,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:49,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,564 INFO [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-11 14:10:49,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure fa4ceb102d347183576477762c1978f5, server=jenkins-hbase9.apache.org,46743,1689084553537 in 185 msec 2023-07-11 14:10:49,565 DEBUG [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1 2023-07-11 14:10:49,565 DEBUG [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1 2023-07-11 14:10:49,566 INFO [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daba5eabb4b40fdec155cf1e437895d9 columnFamilyName family1 2023-07-11 14:10:49,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fa4ceb102d347183576477762c1978f5, ASSIGN in 350 msec 2023-07-11 14:10:49,566 INFO [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] regionserver.HStore(310): Store=daba5eabb4b40fdec155cf1e437895d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:49,567 INFO [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,568 DEBUG [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2 2023-07-11 14:10:49,568 DEBUG [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2 2023-07-11 14:10:49,568 INFO [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daba5eabb4b40fdec155cf1e437895d9 columnFamilyName family2 2023-07-11 14:10:49,569 INFO [StoreOpener-daba5eabb4b40fdec155cf1e437895d9-1] regionserver.HStore(310): Store=daba5eabb4b40fdec155cf1e437895d9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:49,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:49,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:10:49,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:49,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened daba5eabb4b40fdec155cf1e437895d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68451750, jitterRate=0.020010560750961304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:49,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:49,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9., pid=111, masterSystemTime=1689084649529 2023-07-11 14:10:49,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:49,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:49,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:49,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bcf670488a25fe6c22291cd6aac15c1e, NAME => 'ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 14:10:49,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=daba5eabb4b40fdec155cf1e437895d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:49,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689084649577"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084649577"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084649577"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084649577"}]},"ts":"1689084649577"} 2023-07-11 14:10:49,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:10:49,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,579 INFO [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,580 DEBUG [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1 2023-07-11 14:10:49,580 DEBUG [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1 2023-07-11 14:10:49,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=106 2023-07-11 14:10:49,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure daba5eabb4b40fdec155cf1e437895d9, server=jenkins-hbase9.apache.org,46743,1689084553537 in 201 msec 2023-07-11 14:10:49,580 INFO [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcf670488a25fe6c22291cd6aac15c1e columnFamilyName family1 2023-07-11 14:10:49,581 INFO [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] regionserver.HStore(310): Store=bcf670488a25fe6c22291cd6aac15c1e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:49,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=daba5eabb4b40fdec155cf1e437895d9, ASSIGN in 365 msec 2023-07-11 14:10:49,581 INFO [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,582 DEBUG [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2 2023-07-11 14:10:49,582 DEBUG [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2 2023-07-11 14:10:49,582 INFO [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcf670488a25fe6c22291cd6aac15c1e columnFamilyName family2 2023-07-11 14:10:49,583 INFO [StoreOpener-bcf670488a25fe6c22291cd6aac15c1e-1] regionserver.HStore(310): Store=bcf670488a25fe6c22291cd6aac15c1e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:10:49,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:10:49,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:10:49,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:10:49,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened bcf670488a25fe6c22291cd6aac15c1e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67093620, jitterRate=-2.2715330123901367E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:10:49,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:49,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e., pid=110, masterSystemTime=1689084649529 2023-07-11 14:10:49,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:49,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:49,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=bcf670488a25fe6c22291cd6aac15c1e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:49,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689084649589"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084649589"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084649589"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084649589"}]},"ts":"1689084649589"} 2023-07-11 14:10:49,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-07-11 14:10:49,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure bcf670488a25fe6c22291cd6aac15c1e, server=jenkins-hbase9.apache.org,46743,1689084553537 in 212 msec 2023-07-11 14:10:49,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-07-11 14:10:49,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcf670488a25fe6c22291cd6aac15c1e, ASSIGN in 376 msec 2023-07-11 14:10:49,592 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:10:49,592 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084649592"}]},"ts":"1689084649592"} 2023-07-11 14:10:49,593 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-07-11 14:10:49,595 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:10:49,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2270 sec 2023-07-11 14:10:49,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-37653409f4b34c9db5f325ee9a4987b0, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-270804cab88943debd5680faf46e9c7b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-9e3a84cc98e7437ba0993261023412e4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-a6b9d38f77ca4131b91956061470e1b9] to archive 2023-07-11 14:10:49,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:49,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-37653409f4b34c9db5f325ee9a4987b0 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-37653409f4b34c9db5f325ee9a4987b0 2023-07-11 14:10:49,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-270804cab88943debd5680faf46e9c7b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-270804cab88943debd5680faf46e9c7b 2023-07-11 14:10:49,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-9e3a84cc98e7437ba0993261023412e4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-9e3a84cc98e7437ba0993261023412e4 2023-07-11 14:10:49,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-a6b9d38f77ca4131b91956061470e1b9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/family2/testCompactionWithHFileLink=9aaa666cabc8359a75b55d380a2e4fac-a6b9d38f77ca4131b91956061470e1b9 2023-07-11 14:10:50,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 14:10:50,485 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-07-11 14:10:50,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:50,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:50,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:50,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:50,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 14:10:50,499 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 14:10:50,499 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:50,499 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 14:10:50,499 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 14:10:50,500 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:50,500 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:50,502 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:50,502 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:50,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:50,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:50,502 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:50,502 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:50,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:50,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:50,503 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 14:10:50,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 14:10:50,503 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 14:10:50,503 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:50,503 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 14:10:50,506 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:50,506 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. started... 2023-07-11 14:10:50,506 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:50,506 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. started... 2023-07-11 14:10:50,510 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:50,510 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:50,513 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:50,513 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa4ceb102d347183576477762c1978f5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:10:50,513 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. started... 2023-07-11 14:10:50,513 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing daba5eabb4b40fdec155cf1e437895d9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:10:50,514 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bcf670488a25fe6c22291cd6aac15c1e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:10:50,553 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071172c1f874ec6d474ea907e7d35f8a686c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071172c1f874ec6d474ea907e7d35f8a686c 2023-07-11 14:10:50,553 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711ae72ae17bd594bfe94216e4e92444fd4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711ae72ae17bd594bfe94216e4e92444fd4 2023-07-11 14:10:50,564 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/59cb683f9acd42eda5877268cf80f034 2023-07-11 14:10:50,565 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/3859f250115b420ebb3645d0ac584e57 2023-07-11 14:10:50,944 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711552c8728740046cdac8c48b5f0daa392 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711552c8728740046cdac8c48b5f0daa392 2023-07-11 14:10:50,987 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/479793a3af0844809e01d496f82c4412 2023-07-11 14:10:50,998 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307113ae8c4856a5e4b46915fe5a674b2463f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202307113ae8c4856a5e4b46915fe5a674b2463f 2023-07-11 14:10:51,002 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307116c5ec4ae26394442b27e6d318cfc4a15 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202307116c5ec4ae26394442b27e6d318cfc4a15 2023-07-11 14:10:51,042 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/b23b4b2ae83840b3bbd3920bc0b36add 2023-07-11 14:10:51,048 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/59cb683f9acd42eda5877268cf80f034 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/59cb683f9acd42eda5877268cf80f034 2023-07-11 14:10:51,052 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/59cb683f9acd42eda5877268cf80f034, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 14:10:51,053 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/b23b4b2ae83840b3bbd3920bc0b36add as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b23b4b2ae83840b3bbd3920bc0b36add 2023-07-11 14:10:51,058 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b23b4b2ae83840b3bbd3920bc0b36add, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:10:51,059 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bcf670488a25fe6c22291cd6aac15c1e in 545ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:51,059 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-07-11 14:10:51,060 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:51,060 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:51,060 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:51,062 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/043d96d3b2ca4d7e81353e59db6130c7 2023-07-11 14:10:51,068 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/3859f250115b420ebb3645d0ac584e57 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/3859f250115b420ebb3645d0ac584e57 2023-07-11 14:10:51,070 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307112b74f25eafea40479d2d226dfbee5731 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202307112b74f25eafea40479d2d226dfbee5731 2023-07-11 14:10:51,075 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/3859f250115b420ebb3645d0ac584e57, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 14:10:51,077 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/043d96d3b2ca4d7e81353e59db6130c7 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/043d96d3b2ca4d7e81353e59db6130c7 2023-07-11 14:10:51,081 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/043d96d3b2ca4d7e81353e59db6130c7, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:10:51,082 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for daba5eabb4b40fdec155cf1e437895d9 in 569ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:51,086 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:51,086 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:51,086 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:51,091 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/2958b264b71d4a2f97550bb0b8baa731 2023-07-11 14:10:51,097 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/479793a3af0844809e01d496f82c4412 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/479793a3af0844809e01d496f82c4412 2023-07-11 14:10:51,101 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/479793a3af0844809e01d496f82c4412, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 14:10:51,102 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/2958b264b71d4a2f97550bb0b8baa731 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/2958b264b71d4a2f97550bb0b8baa731 2023-07-11 14:10:51,118 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/2958b264b71d4a2f97550bb0b8baa731, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:10:51,119 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fa4ceb102d347183576477762c1978f5 in 606ms, sequenceid=5, compaction requested=false 2023-07-11 14:10:51,119 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:51,119 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:51,119 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:51,119 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:51,119 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,119 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 14:10:51,119 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 14:10:51,123 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,123 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:51,123 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,123 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:51,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 14:10:51,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13c31859[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:51,125 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 14:10:51,125 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,127 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,127 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 14:10:51,127 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 14:10:51,127 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:51,127 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,127 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:51,128 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 14:10:51,128 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,128 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:51,129 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 14:10:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:51,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:51,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:51,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 14:10:51,132 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 14:10:51,132 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:51,132 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:51,132 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 14:10:51,132 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:51,136 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,136 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:51,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:51,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,137 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:51,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:51,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:51,139 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,141 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,150 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,150 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:51,150 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:51,150 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:51,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:51,150 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,150 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:51,150 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:51,150 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,151 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:51,151 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:51,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 14:10:51,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:51,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:51,151 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:51,151 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:51,251 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:51,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:51,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:51,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:51,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:51,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:51,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 14:10:51,276 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 14:10:51,276 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:51,276 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 14:10:51,276 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 14:10:51,276 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,276 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:51,278 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,278 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:51,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:51,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:51,278 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:51,278 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:51,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:51,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:51,279 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 14:10:51,280 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-11 14:10:51,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 14:10:51,280 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 14:10:51,280 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:51,280 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 14:10:51,280 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:51,280 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. started... 2023-07-11 14:10:51,280 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa4ceb102d347183576477762c1978f5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:10:51,282 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:51,282 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. started... 2023-07-11 14:10:51,282 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing daba5eabb4b40fdec155cf1e437895d9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:10:51,283 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:51,284 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:51,285 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:51,286 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. started... 2023-07-11 14:10:51,286 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bcf670488a25fe6c22291cd6aac15c1e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:10:51,343 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711c9c66c8190ce479cb5b19a537cc5a951 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230711c9c66c8190ce479cb5b19a537cc5a951 2023-07-11 14:10:51,343 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711709ba6fb6940484d949b26bd147024d9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711709ba6fb6940484d949b26bd147024d9 2023-07-11 14:10:51,736 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711f11d9321ad304d7abab7060fd2306988 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711f11d9321ad304d7abab7060fd2306988 2023-07-11 14:10:51,757 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/877eab684f604a5dae255d7e567692ce 2023-07-11 14:10:51,757 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/c1e106e9505e42febf18dd6e2ce05d2b 2023-07-11 14:10:51,777 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071193c0f471c63b48748ea5f683deb23d1f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023071193c0f471c63b48748ea5f683deb23d1f 2023-07-11 14:10:51,779 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711ace79750ffa0474687ea6dba4209e158 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230711ace79750ffa0474687ea6dba4209e158 2023-07-11 14:10:51,791 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/621eb23267b441ca8db65a7650c462a4 2023-07-11 14:10:51,795 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/c1e106e9505e42febf18dd6e2ce05d2b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/c1e106e9505e42febf18dd6e2ce05d2b 2023-07-11 14:10:51,799 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/c1e106e9505e42febf18dd6e2ce05d2b, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 14:10:51,799 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/621eb23267b441ca8db65a7650c462a4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/621eb23267b441ca8db65a7650c462a4 2023-07-11 14:10:51,803 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/621eb23267b441ca8db65a7650c462a4, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:10:51,803 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for daba5eabb4b40fdec155cf1e437895d9 in 521ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:51,804 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:51,804 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:51,804 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:52,146 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/cd2b2d71e1dd4928bedafcdf187a71de 2023-07-11 14:10:52,161 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711492fcaf4432e41b3acd7182d84172f90 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711492fcaf4432e41b3acd7182d84172f90 2023-07-11 14:10:52,188 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/6c46ec031bf24a788162d609c00d5ccf 2023-07-11 14:10:52,192 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/7e5d36083d334760b6e3a2bb0fbdb072 2023-07-11 14:10:52,197 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/cd2b2d71e1dd4928bedafcdf187a71de as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/cd2b2d71e1dd4928bedafcdf187a71de 2023-07-11 14:10:52,198 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/877eab684f604a5dae255d7e567692ce as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/877eab684f604a5dae255d7e567692ce 2023-07-11 14:10:52,211 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/cd2b2d71e1dd4928bedafcdf187a71de, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 14:10:52,212 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/6c46ec031bf24a788162d609c00d5ccf as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6c46ec031bf24a788162d609c00d5ccf 2023-07-11 14:10:52,212 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/877eab684f604a5dae255d7e567692ce, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 14:10:52,213 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/7e5d36083d334760b6e3a2bb0fbdb072 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/7e5d36083d334760b6e3a2bb0fbdb072 2023-07-11 14:10:52,220 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/7e5d36083d334760b6e3a2bb0fbdb072, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:10:52,222 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bcf670488a25fe6c22291cd6aac15c1e in 936ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:52,222 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:52,225 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:52,225 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:52,225 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6c46ec031bf24a788162d609c00d5ccf, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:10:52,226 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fa4ceb102d347183576477762c1978f5 in 946ms, sequenceid=9, compaction requested=false 2023-07-11 14:10:52,227 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:52,227 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:52,227 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:52,227 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:52,227 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,227 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 14:10:52,227 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 14:10:52,229 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,229 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:52,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:52,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:52,230 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,230 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:52,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:52,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:52,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:52,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 14:10:52,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ffa6890[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:52,232 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 14:10:52,232 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,233 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,233 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 14:10:52,233 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 14:10:52,233 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:52,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:52,240 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 14:10:52,240 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:52,240 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,240 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 14:10:52,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:52,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:52,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:52,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:52,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:52,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:52,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:52,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 14:10:52,244 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 14:10:52,244 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:52,244 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:52,244 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 14:10:52,244 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:52,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:52,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,245 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:52,246 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:52,247 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 14:10:52,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:52,251 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:52,251 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:52,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:52,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:52,252 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:52,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:52,252 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:52,352 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:52,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:52,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:52,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:52,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:52,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:52,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:52,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 14:10:52,366 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 14:10:52,366 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:52,366 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 14:10:52,366 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 14:10:52,366 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,366 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:52,368 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:52,368 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:52,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:52,369 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:52,369 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:52,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:52,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:52,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:52,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:52,370 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 14:10:52,371 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-11 14:10:52,371 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 14:10:52,371 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 14:10:52,371 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:52,371 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 14:10:52,371 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:52,371 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:52,371 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:52,371 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:52,371 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. started... 2023-07-11 14:10:52,371 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:52,371 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. started... 2023-07-11 14:10:52,371 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. started... 2023-07-11 14:10:52,371 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa4ceb102d347183576477762c1978f5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:10:52,371 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing daba5eabb4b40fdec155cf1e437895d9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:10:52,371 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bcf670488a25fe6c22291cd6aac15c1e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:10:52,423 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071186b4a3b99d374680a4b4d95f440a0315 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023071186b4a3b99d374680a4b4d95f440a0315 2023-07-11 14:10:52,426 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711f39301a6b2c04326a6363c9883697162 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711f39301a6b2c04326a6363c9883697162 2023-07-11 14:10:52,442 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/5776cf87494048f99f892cb7e9484416 2023-07-11 14:10:52,465 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307110f5e8cf37c1e4a2a8520fe7e85868589 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202307110f5e8cf37c1e4a2a8520fe7e85868589 2023-07-11 14:10:52,819 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307117b9ec84931e048b9a4d92af0475ec5bd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202307117b9ec84931e048b9a4d92af0475ec5bd 2023-07-11 14:10:52,824 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/40481b4e6053443fb8c2e5cf67b1115c 2023-07-11 14:10:52,849 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/db34bd1569464315b2f9f5d6382f2d22 2023-07-11 14:10:52,873 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/747fa51c5b9a4634b47e132d28ae6c59 2023-07-11 14:10:52,878 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/5776cf87494048f99f892cb7e9484416 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/5776cf87494048f99f892cb7e9484416 2023-07-11 14:10:52,884 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/5776cf87494048f99f892cb7e9484416, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 14:10:52,885 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/747fa51c5b9a4634b47e132d28ae6c59 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/747fa51c5b9a4634b47e132d28ae6c59 2023-07-11 14:10:52,889 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071102ae5b046b0d4eb4a9b09d4ac1c0fb0f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023071102ae5b046b0d4eb4a9b09d4ac1c0fb0f 2023-07-11 14:10:52,890 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/747fa51c5b9a4634b47e132d28ae6c59, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:10:52,891 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fa4ceb102d347183576477762c1978f5 in 520ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:52,891 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:52,891 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:52,891 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:52,901 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/587ff637190848f7aa1e262d3122c88b 2023-07-11 14:10:52,905 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/db34bd1569464315b2f9f5d6382f2d22 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/db34bd1569464315b2f9f5d6382f2d22 2023-07-11 14:10:52,910 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/db34bd1569464315b2f9f5d6382f2d22, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 14:10:52,912 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/587ff637190848f7aa1e262d3122c88b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/587ff637190848f7aa1e262d3122c88b 2023-07-11 14:10:52,916 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/587ff637190848f7aa1e262d3122c88b, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:10:52,917 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bcf670488a25fe6c22291cd6aac15c1e in 546ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:52,917 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:52,917 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:52,917 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:53,250 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711b80d1624b9d242d09af924c55b603db1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230711b80d1624b9d242d09af924c55b603db1 2023-07-11 14:10:53,657 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/a6a59310dab34b4d8e09a82adb5a2057 2023-07-11 14:10:53,673 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/40481b4e6053443fb8c2e5cf67b1115c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/40481b4e6053443fb8c2e5cf67b1115c 2023-07-11 14:10:53,678 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/40481b4e6053443fb8c2e5cf67b1115c, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 14:10:53,679 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/a6a59310dab34b4d8e09a82adb5a2057 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/a6a59310dab34b4d8e09a82adb5a2057 2023-07-11 14:10:53,687 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/a6a59310dab34b4d8e09a82adb5a2057, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:10:53,688 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for daba5eabb4b40fdec155cf1e437895d9 in 1317ms, sequenceid=13, compaction requested=true 2023-07-11 14:10:53,688 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:53,688 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:53,688 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:53,688 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:53,688 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,688 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 14:10:53,689 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 14:10:53,690 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,690 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:53,691 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,691 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:53,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 14:10:53,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dd84b06[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:53,692 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 14:10:53,692 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,693 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,693 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,693 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 14:10:53,693 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:53,693 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 14:10:53,693 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:53,696 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,696 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 14:10:53,696 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:53,696 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 14:10:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:53,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 14:10:53,699 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 14:10:53,699 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:53,699 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:53,699 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 14:10:53,699 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:53,701 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,701 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:53,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,701 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:53,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:53,702 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,704 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,706 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:53,706 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:53,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:53,707 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,707 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:53,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:53,707 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:53,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 14:10:53,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:53,707 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:53,707 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,707 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,707 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:53,707 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,708 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:53,708 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:53,808 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:53,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:53,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:53,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:53,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:10:53,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:53,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:53,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 14:10:53,862 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 14:10:53,862 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:53,862 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 14:10:53,862 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 14:10:53,862 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,862 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:53,864 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:53,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:53,864 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:53,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:53,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:53,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:53,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 14:10:53,866 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:53,866 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:53,871 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-11 14:10:53,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 14:10:53,871 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 14:10:53,872 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:53,872 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 14:10:53,885 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:53,885 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. started... 2023-07-11 14:10:53,885 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa4ceb102d347183576477762c1978f5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:10:53,886 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:53,886 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. started... 2023-07-11 14:10:53,886 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing daba5eabb4b40fdec155cf1e437895d9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:10:53,887 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:53,887 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:53,887 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:53,887 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. started... 2023-07-11 14:10:53,887 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bcf670488a25fe6c22291cd6aac15c1e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:10:54,331 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711c41d9f9aba5f49f896e4933c714564e9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230711c41d9f9aba5f49f896e4933c714564e9 2023-07-11 14:10:54,350 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711fae97b7ea4e24cbf9f16d2c38cfb3ef3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711fae97b7ea4e24cbf9f16d2c38cfb3ef3 2023-07-11 14:10:54,362 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/a8008bba72d548d29a841846f60f4e17 2023-07-11 14:10:54,362 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307113605d069206140d0b2f94eef92e5ce53 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202307113605d069206140d0b2f94eef92e5ce53 2023-07-11 14:10:54,415 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/7ad77d4c5c484dd482d0db7cc7849905 2023-07-11 14:10:54,418 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/10d9101b37f945e09e27000f18e9f5bb 2023-07-11 14:10:54,479 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307119fd22469df5e4726950a6cf10e8d44d6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202307119fd22469df5e4726950a6cf10e8d44d6 2023-07-11 14:10:54,493 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711cabd65948e6d42a98370632f2ab37872 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711cabd65948e6d42a98370632f2ab37872 2023-07-11 14:10:54,503 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/b3bec533c30a46b9a10303225e9bb629 2023-07-11 14:10:54,511 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/7ad77d4c5c484dd482d0db7cc7849905 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/7ad77d4c5c484dd482d0db7cc7849905 2023-07-11 14:10:54,516 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/7ad77d4c5c484dd482d0db7cc7849905, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 14:10:54,517 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/b3bec533c30a46b9a10303225e9bb629 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b3bec533c30a46b9a10303225e9bb629 2023-07-11 14:10:54,522 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b3bec533c30a46b9a10303225e9bb629, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:10:54,523 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bcf670488a25fe6c22291cd6aac15c1e in 635ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:54,523 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:54,523 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:54,523 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:54,524 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/6d685cdd036c4935823b56ef1cba5c55 2023-07-11 14:10:54,528 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/10d9101b37f945e09e27000f18e9f5bb as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/10d9101b37f945e09e27000f18e9f5bb 2023-07-11 14:10:54,531 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/10d9101b37f945e09e27000f18e9f5bb, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 14:10:54,532 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/6d685cdd036c4935823b56ef1cba5c55 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6d685cdd036c4935823b56ef1cba5c55 2023-07-11 14:10:54,541 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6d685cdd036c4935823b56ef1cba5c55, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:10:54,542 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fa4ceb102d347183576477762c1978f5 in 657ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:54,542 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:54,542 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:54,542 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:54,879 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071140f2297cb7344fb3af2b2a8c730a3ccb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023071140f2297cb7344fb3af2b2a8c730a3ccb 2023-07-11 14:10:54,884 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/1c62283338ab4867be4c33823a45cbd2 2023-07-11 14:10:54,889 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/a8008bba72d548d29a841846f60f4e17 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/a8008bba72d548d29a841846f60f4e17 2023-07-11 14:10:54,903 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/a8008bba72d548d29a841846f60f4e17, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 14:10:54,904 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/1c62283338ab4867be4c33823a45cbd2 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/1c62283338ab4867be4c33823a45cbd2 2023-07-11 14:10:54,914 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/1c62283338ab4867be4c33823a45cbd2, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:10:54,915 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for daba5eabb4b40fdec155cf1e437895d9 in 1029ms, sequenceid=17, compaction requested=true 2023-07-11 14:10:54,915 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:54,915 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:54,915 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:54,915 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:54,915 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,915 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 14:10:54,915 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 14:10:54,923 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:54,923 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:54,923 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,923 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:54,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:54,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:54,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:54,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 14:10:54,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2504633f[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:54,925 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 14:10:54,925 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,926 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,927 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 14:10:54,927 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 14:10:54,927 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:54,927 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,927 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:54,928 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 14:10:54,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:54,928 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 14:10:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:54,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:54,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:54,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:54,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:54,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:54,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:54,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 14:10:54,933 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 14:10:54,933 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:54,933 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:54,933 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 14:10:54,933 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:54,935 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:54,935 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:54,935 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:54,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:54,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:54,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:54,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:54,936 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:54,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:54,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:54,938 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,941 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,942 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:54,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-11 14:10:54,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 14:10:54,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:54,942 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:54,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:54,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:54,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:54,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:55,035 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:10:55,042 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:55,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:55,076 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:55,076 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f1743e2 to 127.0.0.1:63702 2023-07-11 14:10:55,076 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:55,076 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:55,076 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:10:55,077 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x386c05d0 to 127.0.0.1:63702 2023-07-11 14:10:55,077 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:10:55,100 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:55,121 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:10:55,122 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:10:55,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:10:55,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 14:10:55,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 14:10:55,194 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 14:10:55,194 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:55,194 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 14:10:55,194 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 14:10:55,194 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:55,194 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:55,196 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:55,196 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:55,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:55,196 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:55,197 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:10:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:55,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:10:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:55,198 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 14:10:55,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 14:10:55,204 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 14:10:55,204 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:10:55,204 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 14:10:55,206 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:55,206 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. started... 2023-07-11 14:10:55,206 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa4ceb102d347183576477762c1978f5 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:10:55,210 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:55,210 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. started... 2023-07-11 14:10:55,210 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing daba5eabb4b40fdec155cf1e437895d9 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:10:55,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:10:55,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:10:55,221 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:55,222 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. started... 2023-07-11 14:10:55,222 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bcf670488a25fe6c22291cd6aac15c1e 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:10:55,266 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/485d462e1eda404f8c67cf5176e5a534 2023-07-11 14:10:55,272 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 485d462e1eda404f8c67cf5176e5a534 2023-07-11 14:10:55,666 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/ffc30abfe21140f7a6861ad7699f1d26 2023-07-11 14:10:55,670 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffc30abfe21140f7a6861ad7699f1d26 2023-07-11 14:10:55,711 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/a7d6590c744d41909cb90038fb550442 2023-07-11 14:10:55,716 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7d6590c744d41909cb90038fb550442 2023-07-11 14:10:55,716 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/485d462e1eda404f8c67cf5176e5a534 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/485d462e1eda404f8c67cf5176e5a534 2023-07-11 14:10:55,723 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 485d462e1eda404f8c67cf5176e5a534 2023-07-11 14:10:55,723 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/485d462e1eda404f8c67cf5176e5a534, entries=3, sequenceid=23, filesize=5.0 K 2023-07-11 14:10:55,724 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/a7d6590c744d41909cb90038fb550442 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/a7d6590c744d41909cb90038fb550442 2023-07-11 14:10:55,729 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7d6590c744d41909cb90038fb550442 2023-07-11 14:10:55,729 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/a7d6590c744d41909cb90038fb550442, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 14:10:55,729 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fa4ceb102d347183576477762c1978f5 in 523ms, sequenceid=23, compaction requested=true 2023-07-11 14:10:55,730 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:55,730 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:55,730 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:10:56,066 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/30acd1c182de484d8355d911a0249b3b 2023-07-11 14:10:56,070 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30acd1c182de484d8355d911a0249b3b 2023-07-11 14:10:56,082 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/c0376ca8fa48407d963c178a17a03072 2023-07-11 14:10:56,085 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0376ca8fa48407d963c178a17a03072 2023-07-11 14:10:56,086 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/30acd1c182de484d8355d911a0249b3b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/30acd1c182de484d8355d911a0249b3b 2023-07-11 14:10:56,089 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30acd1c182de484d8355d911a0249b3b 2023-07-11 14:10:56,089 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/30acd1c182de484d8355d911a0249b3b, entries=3, sequenceid=23, filesize=5.0 K 2023-07-11 14:10:56,090 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/c0376ca8fa48407d963c178a17a03072 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/c0376ca8fa48407d963c178a17a03072 2023-07-11 14:10:56,095 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0376ca8fa48407d963c178a17a03072 2023-07-11 14:10:56,095 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/c0376ca8fa48407d963c178a17a03072, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 14:10:56,096 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bcf670488a25fe6c22291cd6aac15c1e in 874ms, sequenceid=23, compaction requested=true 2023-07-11 14:10:56,096 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:56,096 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:56,096 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:10:56,484 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/72ebf5a771714f4bbf9e1a5e90f9ea03 2023-07-11 14:10:56,488 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72ebf5a771714f4bbf9e1a5e90f9ea03 2023-07-11 14:10:56,489 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/ffc30abfe21140f7a6861ad7699f1d26 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ffc30abfe21140f7a6861ad7699f1d26 2023-07-11 14:10:56,495 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffc30abfe21140f7a6861ad7699f1d26 2023-07-11 14:10:56,495 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ffc30abfe21140f7a6861ad7699f1d26, entries=3, sequenceid=23, filesize=5.0 K 2023-07-11 14:10:56,496 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/72ebf5a771714f4bbf9e1a5e90f9ea03 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/72ebf5a771714f4bbf9e1a5e90f9ea03 2023-07-11 14:10:56,508 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72ebf5a771714f4bbf9e1a5e90f9ea03 2023-07-11 14:10:56,508 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/72ebf5a771714f4bbf9e1a5e90f9ea03, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 14:10:56,510 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for daba5eabb4b40fdec155cf1e437895d9 in 1300ms, sequenceid=23, compaction requested=true 2023-07-11 14:10:56,513 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:56,513 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:56,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:10:56,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:10:56,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 14:10:56,514 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 14:10:56,516 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,516 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:56,516 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,516 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:10:56,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:56,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:56,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:56,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 14:10:56,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e0eb616[Count = 0] remaining members to acquire global barrier 2023-07-11 14:10:56,518 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 14:10:56,518 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,520 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,520 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 14:10:56,520 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 14:10:56,520 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:10:56,520 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,520 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:10:56,525 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 14:10:56,525 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,526 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:56,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:56,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:56,526 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 14:10:56,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:56,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:56,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:10:56,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 14:10:56,533 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 14:10:56,533 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:10:56,533 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:10:56,533 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 14:10:56,533 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:10:56,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:56,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:10:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:10:56,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:56,535 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:56,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:10:56,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:56,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:56,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:56,538 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:56,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:10:56,540 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 14:10:56,542 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,542 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:56,542 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 14:10:56,542 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:10:56,542 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,542 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 14:10:56,542 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 14:10:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:10:56,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 14:10:56,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:10:56,542 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:10:56,543 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 14:10:56,543 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:10:56,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:10:56,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-11 14:10:56,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:10:56,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:10:56,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:10:56,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:10:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:10:56,643 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:10:56,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:10:56,645 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:56,646 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): fa4ceb102d347183576477762c1978f5/family1 is initiating major compaction (all files) 2023-07-11 14:10:56,646 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:56,646 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:56,646 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of fa4ceb102d347183576477762c1978f5/family1 in ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:56,646 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/479793a3af0844809e01d496f82c4412, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/cd2b2d71e1dd4928bedafcdf187a71de, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/5776cf87494048f99f892cb7e9484416, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/10d9101b37f945e09e27000f18e9f5bb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/485d462e1eda404f8c67cf5176e5a534] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp, totalSize=26.6 K 2023-07-11 14:10:56,647 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 479793a3af0844809e01d496f82c4412, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084650494 2023-07-11 14:10:56,647 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting cd2b2d71e1dd4928bedafcdf187a71de, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084651254 2023-07-11 14:10:56,647 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 5776cf87494048f99f892cb7e9484416, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084652355 2023-07-11 14:10:56,648 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 10d9101b37f945e09e27000f18e9f5bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084653811 2023-07-11 14:10:56,648 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 485d462e1eda404f8c67cf5176e5a534, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:10:56,668 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): fa4ceb102d347183576477762c1978f5#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:57,084 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307110d29fa0c14c743649fe6274d91622b52_del 2023-07-11 14:10:57,084 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307110d29fa0c14c743649fe6274d91622b52_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202307110d29fa0c14c743649fe6274d91622b52_del 2023-07-11 14:10:57,536 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e44e69cb1a2a4e839c2b3afae6bac9d7 2023-07-11 14:10:57,537 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family1/e44e69cb1a2a4e839c2b3afae6bac9d7 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/e44e69cb1a2a4e839c2b3afae6bac9d7 2023-07-11 14:10:57,542 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e44e69cb1a2a4e839c2b3afae6bac9d7 2023-07-11 14:10:57,543 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fa4ceb102d347183576477762c1978f5/family1 of fa4ceb102d347183576477762c1978f5 into e44e69cb1a2a4e839c2b3afae6bac9d7(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:57,543 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:57,543 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:57,543 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): fa4ceb102d347183576477762c1978f5/family2 is initiating major compaction (all files) 2023-07-11 14:10:57,543 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:57,543 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:57,543 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of fa4ceb102d347183576477762c1978f5/family2 in ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:10:57,543 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/2958b264b71d4a2f97550bb0b8baa731, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6c46ec031bf24a788162d609c00d5ccf, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/747fa51c5b9a4634b47e132d28ae6c59, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6d685cdd036c4935823b56ef1cba5c55, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/a7d6590c744d41909cb90038fb550442] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp, totalSize=25.3 K 2023-07-11 14:10:57,544 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 2958b264b71d4a2f97550bb0b8baa731, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084650494 2023-07-11 14:10:57,544 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 6c46ec031bf24a788162d609c00d5ccf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084651254 2023-07-11 14:10:57,545 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 747fa51c5b9a4634b47e132d28ae6c59, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084652355 2023-07-11 14:10:57,545 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 6d685cdd036c4935823b56ef1cba5c55, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084653811 2023-07-11 14:10:57,546 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting a7d6590c744d41909cb90038fb550442, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:10:57,564 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): fa4ceb102d347183576477762c1978f5#family2#compaction#151 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:57,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/479793a3af0844809e01d496f82c4412, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/cd2b2d71e1dd4928bedafcdf187a71de, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/5776cf87494048f99f892cb7e9484416, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/10d9101b37f945e09e27000f18e9f5bb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/485d462e1eda404f8c67cf5176e5a534] to archive 2023-07-11 14:10:57,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:57,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/479793a3af0844809e01d496f82c4412 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/479793a3af0844809e01d496f82c4412 2023-07-11 14:10:57,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/cd2b2d71e1dd4928bedafcdf187a71de to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/cd2b2d71e1dd4928bedafcdf187a71de 2023-07-11 14:10:57,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/5776cf87494048f99f892cb7e9484416 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/5776cf87494048f99f892cb7e9484416 2023-07-11 14:10:57,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/10d9101b37f945e09e27000f18e9f5bb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/10d9101b37f945e09e27000f18e9f5bb 2023-07-11 14:10:57,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/485d462e1eda404f8c67cf5176e5a534 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/485d462e1eda404f8c67cf5176e5a534 2023-07-11 14:10:57,986 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711b50b9ce7f3794118b052b42120bc3b4d_del 2023-07-11 14:10:57,987 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711b50b9ce7f3794118b052b42120bc3b4d_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711b50b9ce7f3794118b052b42120bc3b4d_del 2023-07-11 14:10:58,018 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8c7a46707f84f179024da7f311cc651 2023-07-11 14:10:58,019 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/.tmp/family2/d8c7a46707f84f179024da7f311cc651 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/d8c7a46707f84f179024da7f311cc651 2023-07-11 14:10:58,022 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8c7a46707f84f179024da7f311cc651 2023-07-11 14:10:58,023 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fa4ceb102d347183576477762c1978f5/family2 of fa4ceb102d347183576477762c1978f5 into d8c7a46707f84f179024da7f311cc651(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:58,023 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:10:58,023 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:58,023 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): daba5eabb4b40fdec155cf1e437895d9/family1 is initiating major compaction (all files) 2023-07-11 14:10:58,023 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:58,023 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:58,023 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of daba5eabb4b40fdec155cf1e437895d9/family1 in ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:58,023 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/3859f250115b420ebb3645d0ac584e57, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/c1e106e9505e42febf18dd6e2ce05d2b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/40481b4e6053443fb8c2e5cf67b1115c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/a8008bba72d548d29a841846f60f4e17, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ffc30abfe21140f7a6861ad7699f1d26] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp, totalSize=26.6 K 2023-07-11 14:10:58,024 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 3859f250115b420ebb3645d0ac584e57, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084650493 2023-07-11 14:10:58,024 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting c1e106e9505e42febf18dd6e2ce05d2b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084651254 2023-07-11 14:10:58,025 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 40481b4e6053443fb8c2e5cf67b1115c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084652355 2023-07-11 14:10:58,025 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting a8008bba72d548d29a841846f60f4e17, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084653810 2023-07-11 14:10:58,025 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting ffc30abfe21140f7a6861ad7699f1d26, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:10:58,039 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): daba5eabb4b40fdec155cf1e437895d9#family1#compaction#152 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:58,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/2958b264b71d4a2f97550bb0b8baa731, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6c46ec031bf24a788162d609c00d5ccf, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/747fa51c5b9a4634b47e132d28ae6c59, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6d685cdd036c4935823b56ef1cba5c55, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/a7d6590c744d41909cb90038fb550442] to archive 2023-07-11 14:10:58,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:58,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/2958b264b71d4a2f97550bb0b8baa731 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/2958b264b71d4a2f97550bb0b8baa731 2023-07-11 14:10:58,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6c46ec031bf24a788162d609c00d5ccf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6c46ec031bf24a788162d609c00d5ccf 2023-07-11 14:10:58,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/747fa51c5b9a4634b47e132d28ae6c59 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/747fa51c5b9a4634b47e132d28ae6c59 2023-07-11 14:10:58,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6d685cdd036c4935823b56ef1cba5c55 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/6d685cdd036c4935823b56ef1cba5c55 2023-07-11 14:10:58,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/a7d6590c744d41909cb90038fb550442 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family2/a7d6590c744d41909cb90038fb550442 2023-07-11 14:10:58,449 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307111a933ca2b86f41f6ab70b1e8908a124d_del 2023-07-11 14:10:58,449 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307111a933ca2b86f41f6ab70b1e8908a124d_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202307111a933ca2b86f41f6ab70b1e8908a124d_del 2023-07-11 14:10:58,462 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dee7e0352b614c149af887bae1dd8ccd 2023-07-11 14:10:58,463 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family1/dee7e0352b614c149af887bae1dd8ccd as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/dee7e0352b614c149af887bae1dd8ccd 2023-07-11 14:10:58,467 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dee7e0352b614c149af887bae1dd8ccd 2023-07-11 14:10:58,468 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in daba5eabb4b40fdec155cf1e437895d9/family1 of daba5eabb4b40fdec155cf1e437895d9 into dee7e0352b614c149af887bae1dd8ccd(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:58,468 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:58,468 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:58,468 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): daba5eabb4b40fdec155cf1e437895d9/family2 is initiating major compaction (all files) 2023-07-11 14:10:58,468 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:58,468 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:58,468 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of daba5eabb4b40fdec155cf1e437895d9/family2 in ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:10:58,468 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/043d96d3b2ca4d7e81353e59db6130c7, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/621eb23267b441ca8db65a7650c462a4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/a6a59310dab34b4d8e09a82adb5a2057, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/1c62283338ab4867be4c33823a45cbd2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/72ebf5a771714f4bbf9e1a5e90f9ea03] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp, totalSize=25.3 K 2023-07-11 14:10:58,469 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 043d96d3b2ca4d7e81353e59db6130c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084650493 2023-07-11 14:10:58,469 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 621eb23267b441ca8db65a7650c462a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084651254 2023-07-11 14:10:58,469 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting a6a59310dab34b4d8e09a82adb5a2057, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084652355 2023-07-11 14:10:58,470 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 1c62283338ab4867be4c33823a45cbd2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084653810 2023-07-11 14:10:58,470 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 72ebf5a771714f4bbf9e1a5e90f9ea03, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:10:58,479 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): daba5eabb4b40fdec155cf1e437895d9#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:58,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/3859f250115b420ebb3645d0ac584e57, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/c1e106e9505e42febf18dd6e2ce05d2b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/40481b4e6053443fb8c2e5cf67b1115c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/a8008bba72d548d29a841846f60f4e17, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ffc30abfe21140f7a6861ad7699f1d26] to archive 2023-07-11 14:10:58,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:58,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/3859f250115b420ebb3645d0ac584e57 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/3859f250115b420ebb3645d0ac584e57 2023-07-11 14:10:58,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/c1e106e9505e42febf18dd6e2ce05d2b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/c1e106e9505e42febf18dd6e2ce05d2b 2023-07-11 14:10:58,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/40481b4e6053443fb8c2e5cf67b1115c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/40481b4e6053443fb8c2e5cf67b1115c 2023-07-11 14:10:58,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/a8008bba72d548d29a841846f60f4e17 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/a8008bba72d548d29a841846f60f4e17 2023-07-11 14:10:58,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ffc30abfe21140f7a6861ad7699f1d26 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ffc30abfe21140f7a6861ad7699f1d26 2023-07-11 14:10:58,887 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023071128d6c6d7a0a34724b167cc9a6d58a3ca_del 2023-07-11 14:10:58,888 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071128d6c6d7a0a34724b167cc9a6d58a3ca_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023071128d6c6d7a0a34724b167cc9a6d58a3ca_del 2023-07-11 14:10:59,307 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d052cd0f51a946d39fab81d5618fa47c 2023-07-11 14:10:59,308 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/.tmp/family2/d052cd0f51a946d39fab81d5618fa47c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/d052cd0f51a946d39fab81d5618fa47c 2023-07-11 14:10:59,318 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d052cd0f51a946d39fab81d5618fa47c 2023-07-11 14:10:59,319 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in daba5eabb4b40fdec155cf1e437895d9/family2 of daba5eabb4b40fdec155cf1e437895d9 into d052cd0f51a946d39fab81d5618fa47c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:59,319 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:10:59,319 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:59,319 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): bcf670488a25fe6c22291cd6aac15c1e/family1 is initiating major compaction (all files) 2023-07-11 14:10:59,319 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:59,319 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:59,320 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of bcf670488a25fe6c22291cd6aac15c1e/family1 in ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:59,320 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/59cb683f9acd42eda5877268cf80f034, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/877eab684f604a5dae255d7e567692ce, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/db34bd1569464315b2f9f5d6382f2d22, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/7ad77d4c5c484dd482d0db7cc7849905, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/30acd1c182de484d8355d911a0249b3b] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp, totalSize=26.6 K 2023-07-11 14:10:59,320 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 59cb683f9acd42eda5877268cf80f034, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084650495 2023-07-11 14:10:59,321 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 877eab684f604a5dae255d7e567692ce, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084651254 2023-07-11 14:10:59,321 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting db34bd1569464315b2f9f5d6382f2d22, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084652355 2023-07-11 14:10:59,322 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 7ad77d4c5c484dd482d0db7cc7849905, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084653811 2023-07-11 14:10:59,322 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 30acd1c182de484d8355d911a0249b3b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:10:59,332 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): bcf670488a25fe6c22291cd6aac15c1e#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:59,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/043d96d3b2ca4d7e81353e59db6130c7, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/621eb23267b441ca8db65a7650c462a4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/a6a59310dab34b4d8e09a82adb5a2057, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/1c62283338ab4867be4c33823a45cbd2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/72ebf5a771714f4bbf9e1a5e90f9ea03] to archive 2023-07-11 14:10:59,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:59,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/043d96d3b2ca4d7e81353e59db6130c7 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/043d96d3b2ca4d7e81353e59db6130c7 2023-07-11 14:10:59,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/621eb23267b441ca8db65a7650c462a4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/621eb23267b441ca8db65a7650c462a4 2023-07-11 14:10:59,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/a6a59310dab34b4d8e09a82adb5a2057 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/a6a59310dab34b4d8e09a82adb5a2057 2023-07-11 14:10:59,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/1c62283338ab4867be4c33823a45cbd2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/1c62283338ab4867be4c33823a45cbd2 2023-07-11 14:10:59,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/72ebf5a771714f4bbf9e1a5e90f9ea03 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family2/72ebf5a771714f4bbf9e1a5e90f9ea03 2023-07-11 14:10:59,741 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711f389c8a19d234113ad4f4351d602e990_del 2023-07-11 14:10:59,742 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711f389c8a19d234113ad4f4351d602e990_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711f389c8a19d234113ad4f4351d602e990_del 2023-07-11 14:10:59,757 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67fcb8516aa2493ea16b2db8a6916d2c 2023-07-11 14:10:59,764 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family1/67fcb8516aa2493ea16b2db8a6916d2c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/67fcb8516aa2493ea16b2db8a6916d2c 2023-07-11 14:10:59,768 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67fcb8516aa2493ea16b2db8a6916d2c 2023-07-11 14:10:59,769 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bcf670488a25fe6c22291cd6aac15c1e/family1 of bcf670488a25fe6c22291cd6aac15c1e into 67fcb8516aa2493ea16b2db8a6916d2c(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:10:59,770 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:10:59,770 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:10:59,770 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): bcf670488a25fe6c22291cd6aac15c1e/family2 is initiating major compaction (all files) 2023-07-11 14:10:59,770 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:10:59,770 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:10:59,771 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of bcf670488a25fe6c22291cd6aac15c1e/family2 in ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:10:59,771 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b23b4b2ae83840b3bbd3920bc0b36add, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/7e5d36083d334760b6e3a2bb0fbdb072, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/587ff637190848f7aa1e262d3122c88b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b3bec533c30a46b9a10303225e9bb629, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/c0376ca8fa48407d963c178a17a03072] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp, totalSize=25.3 K 2023-07-11 14:10:59,771 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting b23b4b2ae83840b3bbd3920bc0b36add, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084650495 2023-07-11 14:10:59,772 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 7e5d36083d334760b6e3a2bb0fbdb072, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084651254 2023-07-11 14:10:59,772 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 587ff637190848f7aa1e262d3122c88b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084652355 2023-07-11 14:10:59,773 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting b3bec533c30a46b9a10303225e9bb629, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084653811 2023-07-11 14:10:59,774 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting c0376ca8fa48407d963c178a17a03072, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:10:59,794 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): bcf670488a25fe6c22291cd6aac15c1e#family2#compaction#155 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:10:59,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/59cb683f9acd42eda5877268cf80f034, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/877eab684f604a5dae255d7e567692ce, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/db34bd1569464315b2f9f5d6382f2d22, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/7ad77d4c5c484dd482d0db7cc7849905, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/30acd1c182de484d8355d911a0249b3b] to archive 2023-07-11 14:10:59,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:10:59,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/59cb683f9acd42eda5877268cf80f034 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/59cb683f9acd42eda5877268cf80f034 2023-07-11 14:10:59,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/877eab684f604a5dae255d7e567692ce to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/877eab684f604a5dae255d7e567692ce 2023-07-11 14:10:59,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/db34bd1569464315b2f9f5d6382f2d22 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/db34bd1569464315b2f9f5d6382f2d22 2023-07-11 14:10:59,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/7ad77d4c5c484dd482d0db7cc7849905 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/7ad77d4c5c484dd482d0db7cc7849905 2023-07-11 14:10:59,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/30acd1c182de484d8355d911a0249b3b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/30acd1c182de484d8355d911a0249b3b 2023-07-11 14:10:59,814 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711a3d11a344bb54bbfbf5ad31345fca652_del 2023-07-11 14:10:59,815 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711a3d11a344bb54bbfbf5ad31345fca652_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230711a3d11a344bb54bbfbf5ad31345fca652_del 2023-07-11 14:11:00,234 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3aefcfed2ccb49718ca6bc7c12bc441a 2023-07-11 14:11:00,237 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/.tmp/family2/3aefcfed2ccb49718ca6bc7c12bc441a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/3aefcfed2ccb49718ca6bc7c12bc441a 2023-07-11 14:11:00,246 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3aefcfed2ccb49718ca6bc7c12bc441a 2023-07-11 14:11:00,248 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bcf670488a25fe6c22291cd6aac15c1e/family2 of bcf670488a25fe6c22291cd6aac15c1e into 3aefcfed2ccb49718ca6bc7c12bc441a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:11:00,248 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:11:00,269 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:00,273 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:00,277 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:00,279 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:00,287 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 14:11:00,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b23b4b2ae83840b3bbd3920bc0b36add, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/7e5d36083d334760b6e3a2bb0fbdb072, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/587ff637190848f7aa1e262d3122c88b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b3bec533c30a46b9a10303225e9bb629, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/c0376ca8fa48407d963c178a17a03072] to archive 2023-07-11 14:11:00,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:00,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b23b4b2ae83840b3bbd3920bc0b36add to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b23b4b2ae83840b3bbd3920bc0b36add 2023-07-11 14:11:00,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/7e5d36083d334760b6e3a2bb0fbdb072 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/7e5d36083d334760b6e3a2bb0fbdb072 2023-07-11 14:11:00,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/587ff637190848f7aa1e262d3122c88b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/587ff637190848f7aa1e262d3122c88b 2023-07-11 14:11:00,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b3bec533c30a46b9a10303225e9bb629 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/b3bec533c30a46b9a10303225e9bb629 2023-07-11 14:11:00,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/c0376ca8fa48407d963c178a17a03072 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family2/c0376ca8fa48407d963c178a17a03072 2023-07-11 14:11:00,314 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-07-11 14:11:00,319 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307111a933ca2b86f41f6ab70b1e8908a124d_del 2023-07-11 14:11:00,325 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307110d29fa0c14c743649fe6274d91622b52_del 2023-07-11 14:11:00,329 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711f389c8a19d234113ad4f4351d602e990_del 2023-07-11 14:11:00,329 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:00,330 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(139): Connect 0x04ed70f3 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:11:00,345 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@328248ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:11:00,347 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 14:11:00,347 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 14:11:00,347 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 14:11:00,394 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071142ffd276182d49179705e7eb88336a1e to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023071142ffd276182d49179705e7eb88336a1e 2023-07-11 14:11:00,395 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:00,408 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:11:00,411 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:11:00,425 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:11:00,430 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:11:00,451 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/7669b3f67df7422dac203c52d70ace79 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-07-11 14:11:00,452 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/7669b3f67df7422dac203c52d70ace79}] 2023-07-11 14:11:00,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/7669b3f67df7422dac203c52d70ace79 for inclusion in fa4ceb102d347183576477762c1978f5/family1 2023-07-11 14:11:00,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-07-11 14:11:00,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 14:11:00,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:11:00,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/7669b3f67df7422dac203c52d70ace79 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__kpu296qrl5oa4h8o47png48ntec7g2qothqmjfqha9vajcna03grgagbifkf5fsh/family1/7669b3f67df7422dac203c52d70ace79 2023-07-11 14:11:00,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__kpu296qrl5oa4h8o47png48ntec7g2qothqmjfqha9vajcna03grgagbifkf5fsh/family1/7669b3f67df7422dac203c52d70ace79 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/49a9e0ff717d4e8a9fae1b9341f0fb1d_SeqId_28_ 2023-07-11 14:11:00,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__kpu296qrl5oa4h8o47png48ntec7g2qothqmjfqha9vajcna03grgagbifkf5fsh/family1/7669b3f67df7422dac203c52d70ace79 into fa4ceb102d347183576477762c1978f5/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/49a9e0ff717d4e8a9fae1b9341f0fb1d_SeqId_28_ - updating store file list. 2023-07-11 14:11:00,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/49a9e0ff717d4e8a9fae1b9341f0fb1d_SeqId_28_ into fa4ceb102d347183576477762c1978f5/family1 2023-07-11 14:11:00,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__kpu296qrl5oa4h8o47png48ntec7g2qothqmjfqha9vajcna03grgagbifkf5fsh/family1/7669b3f67df7422dac203c52d70ace79 into fa4ceb102d347183576477762c1978f5/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/family1/49a9e0ff717d4e8a9fae1b9341f0fb1d_SeqId_28_) 2023-07-11 14:11:00,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__kpu296qrl5oa4h8o47png48ntec7g2qothqmjfqha9vajcna03grgagbifkf5fsh/family1/7669b3f67df7422dac203c52d70ace79 2023-07-11 14:11:00,476 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:00,477 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:00,479 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711552c8728740046cdac8c48b5f0daa392 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711552c8728740046cdac8c48b5f0daa392 2023-07-11 14:11:00,479 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-11 14:11:00,479 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 14:11:00,480 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 14:11:00,784 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071128cc288de3044c8aaea2af853417300b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023071128cc288de3044c8aaea2af853417300b 2023-07-11 14:11:00,785 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:00,811 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/5dcaad448e404ff6a0638c899f9b2ed9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-07-11 14:11:00,811 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/5dcaad448e404ff6a0638c899f9b2ed9}] 2023-07-11 14:11:00,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/5dcaad448e404ff6a0638c899f9b2ed9 for inclusion in bcf670488a25fe6c22291cd6aac15c1e/family1 2023-07-11 14:11:00,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-07-11 14:11:00,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 14:11:00,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:11:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/5dcaad448e404ff6a0638c899f9b2ed9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__oaeq04eflfdop0dpdms1bg0odk6src65h9vishpl5uho1o6c7t0du5fk36siltbe/family1/5dcaad448e404ff6a0638c899f9b2ed9 2023-07-11 14:11:00,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__oaeq04eflfdop0dpdms1bg0odk6src65h9vishpl5uho1o6c7t0du5fk36siltbe/family1/5dcaad448e404ff6a0638c899f9b2ed9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/c64ce7103519424ea0f93bb12861574d_SeqId_28_ 2023-07-11 14:11:00,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__oaeq04eflfdop0dpdms1bg0odk6src65h9vishpl5uho1o6c7t0du5fk36siltbe/family1/5dcaad448e404ff6a0638c899f9b2ed9 into bcf670488a25fe6c22291cd6aac15c1e/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/c64ce7103519424ea0f93bb12861574d_SeqId_28_ - updating store file list. 2023-07-11 14:11:00,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/c64ce7103519424ea0f93bb12861574d_SeqId_28_ into bcf670488a25fe6c22291cd6aac15c1e/family1 2023-07-11 14:11:00,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__oaeq04eflfdop0dpdms1bg0odk6src65h9vishpl5uho1o6c7t0du5fk36siltbe/family1/5dcaad448e404ff6a0638c899f9b2ed9 into bcf670488a25fe6c22291cd6aac15c1e/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/family1/c64ce7103519424ea0f93bb12861574d_SeqId_28_) 2023-07-11 14:11:00,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__oaeq04eflfdop0dpdms1bg0odk6src65h9vishpl5uho1o6c7t0du5fk36siltbe/family1/5dcaad448e404ff6a0638c899f9b2ed9 2023-07-11 14:11:00,824 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:00,824 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:00,826 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711ae72ae17bd594bfe94216e4e92444fd4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711ae72ae17bd594bfe94216e4e92444fd4 2023-07-11 14:11:00,826 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-11 14:11:00,826 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 14:11:00,826 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 14:11:01,186 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711b1f96ac63630474f820f0290a5fda53a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230711b1f96ac63630474f820f0290a5fda53a 2023-07-11 14:11:01,187 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:01,210 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/293d56aa239d48afb8461f68846763ef first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-07-11 14:11:01,210 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/293d56aa239d48afb8461f68846763ef}] 2023-07-11 14:11:01,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/293d56aa239d48afb8461f68846763ef for inclusion in daba5eabb4b40fdec155cf1e437895d9/family1 2023-07-11 14:11:01,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-07-11 14:11:01,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 14:11:01,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:11:01,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/293d56aa239d48afb8461f68846763ef to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__qn3fumqsencn2ogv2qllep2b0m6ududfpb5ihlsk1qdfkd6ddd4udap5tgmst899/family1/293d56aa239d48afb8461f68846763ef 2023-07-11 14:11:01,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__qn3fumqsencn2ogv2qllep2b0m6ududfpb5ihlsk1qdfkd6ddd4udap5tgmst899/family1/293d56aa239d48afb8461f68846763ef as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ba95d6efa9184016bdd50b758b2eba17_SeqId_28_ 2023-07-11 14:11:01,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__qn3fumqsencn2ogv2qllep2b0m6ududfpb5ihlsk1qdfkd6ddd4udap5tgmst899/family1/293d56aa239d48afb8461f68846763ef into daba5eabb4b40fdec155cf1e437895d9/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ba95d6efa9184016bdd50b758b2eba17_SeqId_28_ - updating store file list. 2023-07-11 14:11:01,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ba95d6efa9184016bdd50b758b2eba17_SeqId_28_ into daba5eabb4b40fdec155cf1e437895d9/family1 2023-07-11 14:11:01,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__qn3fumqsencn2ogv2qllep2b0m6ududfpb5ihlsk1qdfkd6ddd4udap5tgmst899/family1/293d56aa239d48afb8461f68846763ef into daba5eabb4b40fdec155cf1e437895d9/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/family1/ba95d6efa9184016bdd50b758b2eba17_SeqId_28_) 2023-07-11 14:11:01,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__ns_testMinorCompaction__qn3fumqsencn2ogv2qllep2b0m6ududfpb5ihlsk1qdfkd6ddd4udap5tgmst899/family1/293d56aa239d48afb8461f68846763ef 2023-07-11 14:11:01,222 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:01,222 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:01,224 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071172c1f874ec6d474ea907e7d35f8a686c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071172c1f874ec6d474ea907e7d35f8a686c 2023-07-11 14:11:01,224 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-11 14:11:01,224 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 14:11:01,224 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 14:11:01,224 INFO [Listener at localhost/44533] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-07-11 14:11:01,227 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:01,229 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:01,231 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:01,232 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:01,250 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=253 (was 285), OpenFileDescriptor=636 (was 738), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=573 (was 625), ProcessCount=181 (was 181), AvailableMemoryMB=1451 (was 624) - AvailableMemoryMB LEAK? - 2023-07-11 14:11:01,262 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=573, ProcessCount=181, AvailableMemoryMB=1450 2023-07-11 14:11:01,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 14:11:01,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:01,266 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:11:01,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-07-11 14:11:01,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:11:01,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 14:11:01,268 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:01,269 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307 empty. 2023-07-11 14:11:01,269 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:01,269 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-07-11 14:11:01,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 14:11:01,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 14:11:01,678 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 14:11:01,682 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => a38c5bec39018a3ce9a9c04acd51b307, NAME => 'testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:11:01,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 14:11:02,106 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:02,106 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing a38c5bec39018a3ce9a9c04acd51b307, disabling compactions & flushes 2023-07-11 14:11:02,106 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:02,106 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:02,106 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. after waiting 0 ms 2023-07-11 14:11:02,106 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:02,106 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:02,106 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:02,108 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:11:02,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689084662109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084662109"}]},"ts":"1689084662109"} 2023-07-11 14:11:02,110 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:11:02,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:11:02,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084662111"}]},"ts":"1689084662111"} 2023-07-11 14:11:02,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-07-11 14:11:02,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a38c5bec39018a3ce9a9c04acd51b307, ASSIGN}] 2023-07-11 14:11:02,116 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a38c5bec39018a3ce9a9c04acd51b307, ASSIGN 2023-07-11 14:11:02,116 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a38c5bec39018a3ce9a9c04acd51b307, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:11:02,267 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a38c5bec39018a3ce9a9c04acd51b307, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:02,268 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689084662267"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084662267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084662267"}]},"ts":"1689084662267"} 2023-07-11 14:11:02,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure a38c5bec39018a3ce9a9c04acd51b307, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:11:02,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 14:11:02,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:02,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a38c5bec39018a3ce9a9c04acd51b307, NAME => 'testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:11:02,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:02,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:02,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:02,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:02,425 INFO [StoreOpener-a38c5bec39018a3ce9a9c04acd51b307-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:02,427 DEBUG [StoreOpener-a38c5bec39018a3ce9a9c04acd51b307-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:02,427 DEBUG [StoreOpener-a38c5bec39018a3ce9a9c04acd51b307-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:02,427 INFO [StoreOpener-a38c5bec39018a3ce9a9c04acd51b307-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a38c5bec39018a3ce9a9c04acd51b307 columnFamilyName family1 2023-07-11 14:11:02,428 INFO [StoreOpener-a38c5bec39018a3ce9a9c04acd51b307-1] regionserver.HStore(310): Store=a38c5bec39018a3ce9a9c04acd51b307/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:11:02,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:02,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:02,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:02,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:11:02,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a38c5bec39018a3ce9a9c04acd51b307; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68786926, jitterRate=0.025005072355270386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:11:02,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:02,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307., pid=114, masterSystemTime=1689084662421 2023-07-11 14:11:02,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:02,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:02,436 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a38c5bec39018a3ce9a9c04acd51b307, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:02,436 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689084662436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084662436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084662436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084662436"}]},"ts":"1689084662436"} 2023-07-11 14:11:02,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-07-11 14:11:02,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure a38c5bec39018a3ce9a9c04acd51b307, server=jenkins-hbase9.apache.org,46743,1689084553537 in 169 msec 2023-07-11 14:11:02,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-07-11 14:11:02,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a38c5bec39018a3ce9a9c04acd51b307, ASSIGN in 325 msec 2023-07-11 14:11:02,441 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:11:02,441 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084662441"}]},"ts":"1689084662441"} 2023-07-11 14:11:02,442 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-07-11 14:11:02,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:11:02,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1820 sec 2023-07-11 14:11:03,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 14:11:03,375 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-07-11 14:11:03,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:03,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,437 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:03,437 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:03,437 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:03,437 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:03,439 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,439 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,441 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:03,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:03,441 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:03,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,447 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:03,447 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:03,447 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:03,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:03,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:03,456 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:03,457 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:03,458 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 14:11:03,919 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130185148af3446470294f6aac0c39015af to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130185148af3446470294f6aac0c39015af 2023-07-11 14:11:03,922 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/0442a974e426466eaa6db26a65feb26c 2023-07-11 14:11:03,931 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/0442a974e426466eaa6db26a65feb26c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/0442a974e426466eaa6db26a65feb26c 2023-07-11 14:11:03,937 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/0442a974e426466eaa6db26a65feb26c, entries=1000, sequenceid=5, filesize=166.0 K 2023-07-11 14:11:03,938 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 480ms, sequenceid=5, compaction requested=false 2023-07-11 14:11:03,938 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:03,938 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:03,938 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:03,938 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:03,938 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:03,938 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,938 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:03,938 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:03,940 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,940 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:03,940 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:03,940 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:03,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:03,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29ce5af[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:03,942 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:03,942 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,944 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,944 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:03,944 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,944 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:03,944 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:03,944 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:03,947 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:03,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:03,948 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:03,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:03,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:03,952 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:03,952 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:03,952 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:03,952 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,952 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:03,958 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,958 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:03,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,958 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:03,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:03,959 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:03,960 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,964 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:03,965 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:03,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:03,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:03,965 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:03,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:03,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:03,965 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:03,965 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:03,965 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,966 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,966 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,966 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:03,966 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,966 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,966 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:03,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:03,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:03,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:11:04,066 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:04,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:04,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:04,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:04,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,073 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:04,073 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:04,073 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:04,074 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:04,074 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,074 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,076 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:04,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:04,076 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:04,076 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,076 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:04,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,077 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,077 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:04,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,077 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:04,077 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:04,077 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:04,078 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:04,079 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:04,079 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:04,079 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:04,079 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 14:11:04,110 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112804843c0c56904c4db16149749ab40fe8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112804843c0c56904c4db16149749ab40fe8 2023-07-11 14:11:04,117 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/b1a58491ea5f42ce8f12cde6507ca709 2023-07-11 14:11:04,124 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/b1a58491ea5f42ce8f12cde6507ca709 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/b1a58491ea5f42ce8f12cde6507ca709 2023-07-11 14:11:04,137 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/b1a58491ea5f42ce8f12cde6507ca709, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 14:11:04,143 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 64ms, sequenceid=9, compaction requested=false 2023-07-11 14:11:04,143 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:04,143 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:04,143 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:04,143 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:04,143 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,143 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:04,143 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:04,146 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,146 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:04,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:04,146 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,146 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:04,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:04,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:04,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:04,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d831e81[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:04,149 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:04,149 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,151 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:04,151 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,151 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:04,153 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,153 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:04,153 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:04,153 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:04,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:04,162 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:04,162 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:04,162 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:04,162 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,162 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:04,164 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:04,165 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,165 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:04,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,166 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,169 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,174 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:04,174 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:04,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:04,174 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,174 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,174 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,174 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,174 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:04,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:04,174 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,175 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,175 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:04,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:04,175 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:04,175 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:04,275 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:04,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:04,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:04,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:04,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,282 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:04,283 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:04,283 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:04,283 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:04,283 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,283 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,288 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:04,288 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:04,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:04,289 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:04,289 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:04,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:04,290 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:04,290 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:04,291 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:04,703 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f6099a2e818a425ab6c7a0150e18d4c6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6099a2e818a425ab6c7a0150e18d4c6 2023-07-11 14:11:05,111 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/c9b7f40ac9cc4c24933589f43e0d3173 2023-07-11 14:11:05,118 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/c9b7f40ac9cc4c24933589f43e0d3173 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/c9b7f40ac9cc4c24933589f43e0d3173 2023-07-11 14:11:05,122 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/c9b7f40ac9cc4c24933589f43e0d3173, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 14:11:05,123 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 832ms, sequenceid=13, compaction requested=true 2023-07-11 14:11:05,123 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:05,123 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:05,123 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:05,124 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:05,124 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,124 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:05,124 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:05,126 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,126 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:05,126 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,126 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:05,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:05,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b988b95[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:05,130 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:05,130 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,131 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,132 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:05,132 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:05,132 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:05,132 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,132 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:05,133 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:05,133 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,133 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:05,133 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:05,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:05,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:05,136 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:05,136 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:05,136 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:05,136 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,136 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:05,138 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,138 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,138 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:05,139 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:05,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:05,142 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,147 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:05,147 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:05,147 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:05,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:05,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:05,148 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:05,148 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:05,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:11:05,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:05,248 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:05,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:05,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:05,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:05,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,258 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:05,258 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:05,258 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:05,258 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:05,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,259 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,260 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:05,260 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,261 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,261 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:05,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:05,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,262 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:05,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,263 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:05,263 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:05,263 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:05,263 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:05,263 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:05,263 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:05,263 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:05,263 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:05,278 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057312196d7eaa4be291e6291c6a8c832a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512057312196d7eaa4be291e6291c6a8c832a 2023-07-11 14:11:05,685 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/4f6d5d8a99184c7f95b91f58851d9fa1 2023-07-11 14:11:05,692 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/4f6d5d8a99184c7f95b91f58851d9fa1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4f6d5d8a99184c7f95b91f58851d9fa1 2023-07-11 14:11:05,699 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4f6d5d8a99184c7f95b91f58851d9fa1, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 14:11:05,700 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 437ms, sequenceid=17, compaction requested=true 2023-07-11 14:11:05,700 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:05,700 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:05,700 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:05,700 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:05,700 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,700 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:05,700 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:05,702 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,702 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:05,702 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,702 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:05,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:05,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@407d20f6[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:05,707 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:05,708 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,710 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,710 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:05,710 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:05,710 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:05,710 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,710 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:05,712 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:05,712 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:05,712 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:05,712 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:05,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:05,716 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:05,716 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:05,716 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:05,716 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,716 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:05,718 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,718 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:05,718 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:05,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:05,720 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,722 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:05,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:05,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:05,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:05,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,725 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:05,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:05,725 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:05,726 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:05,726 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:05,826 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:05,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:05,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:05,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:05,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,860 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:05,860 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:05,860 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:05,860 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:05,862 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,862 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,865 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:05,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:05,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:05,865 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,866 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:05,866 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:05,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:05,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,866 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,878 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:05,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:05,878 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:05,879 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:05,879 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:05,885 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:05,886 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:05,893 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:05,894 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:05,894 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:05,969 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285311ebac38c64cc3882b5141c3b4685c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285311ebac38c64cc3882b5141c3b4685c 2023-07-11 14:11:06,428 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/12b379ed40f845068c1227ccb7c9e4c4 2023-07-11 14:11:06,437 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/12b379ed40f845068c1227ccb7c9e4c4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/12b379ed40f845068c1227ccb7c9e4c4 2023-07-11 14:11:06,443 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/12b379ed40f845068c1227ccb7c9e4c4, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 14:11:06,444 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 550ms, sequenceid=21, compaction requested=true 2023-07-11 14:11:06,444 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:06,444 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:06,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:06,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:06,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:06,444 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:06,446 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,446 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:06,447 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,447 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:06,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:06,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:06,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:06,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:06,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@252914cb[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:06,452 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:06,452 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,453 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,454 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:06,454 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:06,454 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:06,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,454 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:06,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:06,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:06,456 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,456 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:06,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:06,477 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:06,477 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:06,477 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:06,477 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,477 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:06,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:06,482 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:06,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:06,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,491 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,496 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,505 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:06,506 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:06,506 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:06,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:06,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:06,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:06,506 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:06,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:06,507 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:06,607 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:06,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:06,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:06,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:06,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,638 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:06,638 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:06,638 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:06,638 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:06,640 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,640 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,642 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:06,642 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:06,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:06,642 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:06,642 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:06,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:06,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,644 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,652 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:06,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:06,652 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:06,652 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:06,652 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:06,671 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:06,671 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:06,672 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:06,672 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:06,672 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:06,734 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c193a0ccdb704957bf5459df2343a603 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c193a0ccdb704957bf5459df2343a603 2023-07-11 14:11:07,192 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/15cb1dec96d04e46b3c4b2f403ba5e63 2023-07-11 14:11:07,200 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/15cb1dec96d04e46b3c4b2f403ba5e63 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/15cb1dec96d04e46b3c4b2f403ba5e63 2023-07-11 14:11:07,206 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/15cb1dec96d04e46b3c4b2f403ba5e63, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 14:11:07,207 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 535ms, sequenceid=25, compaction requested=true 2023-07-11 14:11:07,207 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:07,207 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,209 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:07,210 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:07,213 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,213 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:07,213 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,213 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:07,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:07,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20db71f9[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:07,216 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:07,216 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,217 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:07,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:07,217 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:07,218 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,218 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:07,219 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,219 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:07,219 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:07,220 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:07,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:07,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:07,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:07,226 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:07,226 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:07,226 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:07,226 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,226 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:07,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:07,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,230 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:07,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:07,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:07,231 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,233 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:07,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:07,237 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:07,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,238 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:07,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:07,238 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:07,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:07,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:11:07,339 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:07,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:07,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:07,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:07,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,358 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:07,358 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:07,358 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:07,358 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:07,360 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,360 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,361 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,361 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:07,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:07,362 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,362 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,365 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:07,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,366 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:07,366 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:07,366 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:07,366 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:07,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:07,367 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:07,367 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:07,367 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:07,896 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010192ae296c944f45a5871636765f69c53a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010192ae296c944f45a5871636765f69c53a 2023-07-11 14:11:07,941 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/39e3d52ba7e945d6977858df6437263f 2023-07-11 14:11:07,947 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/39e3d52ba7e945d6977858df6437263f as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39e3d52ba7e945d6977858df6437263f 2023-07-11 14:11:07,958 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39e3d52ba7e945d6977858df6437263f, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 14:11:07,960 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 593ms, sequenceid=29, compaction requested=true 2023-07-11 14:11:07,960 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:07,960 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:07,960 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:07,960 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:07,960 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,961 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:07,961 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:07,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,963 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:07,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:07,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:07,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:07,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f408254[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:07,966 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:07,966 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,967 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,967 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:07,967 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:07,967 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:07,968 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,968 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:07,970 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:07,970 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:07,970 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,970 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:07,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:07,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:07,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:07,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:07,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:07,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:07,973 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:07,973 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:07,973 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:07,973 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,973 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:07,982 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,982 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:07,982 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:07,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:07,983 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,985 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:07,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,988 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,988 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,988 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:07,989 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:07,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:07,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:07,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:07,989 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:07,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:11:07,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:07,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:08,089 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:08,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:08,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,114 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:08,114 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:08,114 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:08,114 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:08,115 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,115 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,116 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,117 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,117 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:08,118 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:08,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:08,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:08,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:08,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,136 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:08,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,136 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:08,136 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:08,136 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:08,140 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:11:08,146 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:08,146 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:08,147 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:08,147 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:08,148 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:08,243 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103919eef387aa441749877b52ba5c03dde to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103919eef387aa441749877b52ba5c03dde 2023-07-11 14:11:08,280 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/7934eced2c004255a37de53e5928dbf8 2023-07-11 14:11:08,286 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/7934eced2c004255a37de53e5928dbf8 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/7934eced2c004255a37de53e5928dbf8 2023-07-11 14:11:08,291 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/7934eced2c004255a37de53e5928dbf8, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 14:11:08,293 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 145ms, sequenceid=33, compaction requested=true 2023-07-11 14:11:08,293 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:08,293 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:08,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:08,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:08,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:08,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:08,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,296 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:08,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:08,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:08,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:08,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:08,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@561377da[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:08,298 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:08,299 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,300 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,300 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:08,300 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:08,300 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:08,300 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,301 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:08,302 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:08,302 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:08,302 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:08,302 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:08,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:08,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:08,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:08,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:08,313 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:08,313 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:08,313 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:08,313 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,313 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:08,315 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:08,315 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,315 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:08,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,316 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:08,318 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,326 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,326 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,326 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,327 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,327 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,327 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:08,327 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:08,327 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:08,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:08,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:08,328 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:08,328 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:08,327 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,328 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,428 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:08,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:08,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:08,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:08,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,443 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:08,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:08,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:08,443 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:08,444 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,444 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,445 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:08,445 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,446 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,446 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:08,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,447 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,461 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:08,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,462 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:08,462 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:08,462 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:08,463 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:08,463 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:08,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:08,464 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:08,464 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:08,904 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077588ace8a99a4c19a0bcfd16aace460d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509077588ace8a99a4c19a0bcfd16aace460d 2023-07-11 14:11:08,929 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/4b927e2a25ba4594ac420cee0046fed6 2023-07-11 14:11:08,934 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/4b927e2a25ba4594ac420cee0046fed6 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4b927e2a25ba4594ac420cee0046fed6 2023-07-11 14:11:08,942 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4b927e2a25ba4594ac420cee0046fed6, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 14:11:08,946 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 482ms, sequenceid=37, compaction requested=true 2023-07-11 14:11:08,946 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:08,947 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:08,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:08,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:08,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:08,947 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:08,948 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,949 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:08,949 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,949 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:08,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:08,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:08,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:08,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bf1ae9f[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:08,951 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:08,951 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,954 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:08,954 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,954 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:08,955 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,956 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:08,956 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:08,956 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:08,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:08,959 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:08,959 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:08,959 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:08,959 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,959 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:08,961 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,961 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,961 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:08,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:08,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:08,966 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,967 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:08,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:08,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,971 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:08,971 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:08,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:08,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:08,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:11:08,972 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:08,972 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:08,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:08,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:09,072 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:09,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:09,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:09,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:09,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,095 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:09,095 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:09,095 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 14:11:09,095 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 14:11:09,095 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,095 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,097 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:09,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:09,098 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,098 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,098 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:09,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,099 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 14:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 14:11:09,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:09,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 14:11:09,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 14:11:09,100 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:09,100 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:09,100 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. started... 2023-07-11 14:11:09,101 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a38c5bec39018a3ce9a9c04acd51b307 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 14:11:09,168 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203c669c84aa064c3287eeb41c351aeacf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203c669c84aa064c3287eeb41c351aeacf 2023-07-11 14:11:09,174 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/f541c89219d04550bc7063661c304ddc 2023-07-11 14:11:09,179 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/f541c89219d04550bc7063661c304ddc as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/f541c89219d04550bc7063661c304ddc 2023-07-11 14:11:09,183 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/f541c89219d04550bc7063661c304ddc, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 14:11:09,183 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a38c5bec39018a3ce9a9c04acd51b307 in 83ms, sequenceid=41, compaction requested=true 2023-07-11 14:11:09,184 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:09,184 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:09,184 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 14:11:09,184 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 14:11:09,184 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,184 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 14:11:09,184 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 14:11:09,185 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,185 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:09,186 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,186 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:09,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:09,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:09,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 14:11:09,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40de54a1[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:09,188 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 14:11:09,188 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,189 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,189 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 14:11:09,189 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 14:11:09,189 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:09,189 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,189 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:09,192 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 14:11:09,192 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:09,192 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,192 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 14:11:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:09,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 14:11:09,195 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 14:11:09,195 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:09,195 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:09,195 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,195 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:09,198 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,198 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:09,198 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:09,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,199 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,201 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:09,205 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:09,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:09,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:09,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 14:11:09,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:09,205 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,206 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:09,306 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:09,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:09,308 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-07-11 14:11:09,309 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:11:09,310 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:11:09,311 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:11:09,311 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085269311 2023-07-11 14:11:09,311 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 14:11:09,313 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-07-11 14:11:09,313 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:09,313 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x30e02836 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:11:09,320 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@582d609b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:11:09,320 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:09,793 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d26d72c8d6464b02800fde5f7a62a7dc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d26d72c8d6464b02800fde5f7a62a7dc 2023-07-11 14:11:09,794 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:09,816 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:11:09,819 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:11:09,829 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:11:09,832 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:11:09,896 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86ec410e77d246afa7e0caa9aa35b187 first=Optional[r5] last=Optional[r6] 2023-07-11 14:11:09,897 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86ec410e77d246afa7e0caa9aa35b187}] 2023-07-11 14:11:09,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86ec410e77d246afa7e0caa9aa35b187 for inclusion in a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:09,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-07-11 14:11:09,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:11:09,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:09,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86ec410e77d246afa7e0caa9aa35b187 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dkifjianog7o116gpt77k9tgj9ctfbkga42fiqm77fro30gag8oq7gr2covai7tc/family1/86ec410e77d246afa7e0caa9aa35b187 2023-07-11 14:11:09,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dkifjianog7o116gpt77k9tgj9ctfbkga42fiqm77fro30gag8oq7gr2covai7tc/family1/86ec410e77d246afa7e0caa9aa35b187 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_ 2023-07-11 14:11:09,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dkifjianog7o116gpt77k9tgj9ctfbkga42fiqm77fro30gag8oq7gr2covai7tc/family1/86ec410e77d246afa7e0caa9aa35b187 into a38c5bec39018a3ce9a9c04acd51b307/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_ - updating store file list. 2023-07-11 14:11:09,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_ into a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:09,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dkifjianog7o116gpt77k9tgj9ctfbkga42fiqm77fro30gag8oq7gr2covai7tc/family1/86ec410e77d246afa7e0caa9aa35b187 into a38c5bec39018a3ce9a9c04acd51b307/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_) 2023-07-11 14:11:09,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dkifjianog7o116gpt77k9tgj9ctfbkga42fiqm77fro30gag8oq7gr2covai7tc/family1/86ec410e77d246afa7e0caa9aa35b187 2023-07-11 14:11:09,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 14:11:09,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 14:11:09,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): a38c5bec39018a3ce9a9c04acd51b307/family1 is initiating minor compaction 2023-07-11 14:11:09,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f16e275; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:11:09,944 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a38c5bec39018a3ce9a9c04acd51b307/family1 in testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:09,945 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/b1a58491ea5f42ce8f12cde6507ca709, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/c9b7f40ac9cc4c24933589f43e0d3173, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4f6d5d8a99184c7f95b91f58851d9fa1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/12b379ed40f845068c1227ccb7c9e4c4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/15cb1dec96d04e46b3c4b2f403ba5e63, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39e3d52ba7e945d6977858df6437263f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/7934eced2c004255a37de53e5928dbf8, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4b927e2a25ba4594ac420cee0046fed6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/f541c89219d04550bc7063661c304ddc, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp, totalSize=49.7 K 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting b1a58491ea5f42ce8f12cde6507ca709, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting c9b7f40ac9cc4c24933589f43e0d3173, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 4f6d5d8a99184c7f95b91f58851d9fa1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 12b379ed40f845068c1227ccb7c9e4c4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 15cb1dec96d04e46b3c4b2f403ba5e63, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 39e3d52ba7e945d6977858df6437263f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 7934eced2c004255a37de53e5928dbf8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 4b927e2a25ba4594ac420cee0046fed6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting f541c89219d04550bc7063661c304ddc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 14:11:09,945 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 850152ef04a948d2849cd3f900a1c697_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 14:11:09,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:09,949 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:09,951 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010192ae296c944f45a5871636765f69c53a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010192ae296c944f45a5871636765f69c53a 2023-07-11 14:11:09,955 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103919eef387aa441749877b52ba5c03dde to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103919eef387aa441749877b52ba5c03dde 2023-07-11 14:11:09,955 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-07-11 14:11:09,955 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-07-11 14:11:09,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:09,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:10,160 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): a38c5bec39018a3ce9a9c04acd51b307#family1#compaction#166 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:10,210 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231bfc239b78c874b07b8de0800df09776f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231bfc239b78c874b07b8de0800df09776f 2023-07-11 14:11:10,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:10,241 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9d0b691f6e5f48adb497fdf881cbc4a2 first=Optional[r1] last=Optional[r4] 2023-07-11 14:11:10,243 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9d0b691f6e5f48adb497fdf881cbc4a2}] 2023-07-11 14:11:10,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9d0b691f6e5f48adb497fdf881cbc4a2 for inclusion in a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:10,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-07-11 14:11:10,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:11:10,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:10,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9d0b691f6e5f48adb497fdf881cbc4a2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dhbp13l7f7kgr1ipe2lkbvhka1bsqdccnjo28b3u62448cf6og2iq1o74tt4a8b6/family1/9d0b691f6e5f48adb497fdf881cbc4a2 2023-07-11 14:11:10,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dhbp13l7f7kgr1ipe2lkbvhka1bsqdccnjo28b3u62448cf6og2iq1o74tt4a8b6/family1/9d0b691f6e5f48adb497fdf881cbc4a2 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_ 2023-07-11 14:11:10,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dhbp13l7f7kgr1ipe2lkbvhka1bsqdccnjo28b3u62448cf6og2iq1o74tt4a8b6/family1/9d0b691f6e5f48adb497fdf881cbc4a2 into a38c5bec39018a3ce9a9c04acd51b307/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_ - updating store file list. 2023-07-11 14:11:10,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_ into a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:10,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dhbp13l7f7kgr1ipe2lkbvhka1bsqdccnjo28b3u62448cf6og2iq1o74tt4a8b6/family1/9d0b691f6e5f48adb497fdf881cbc4a2 into a38c5bec39018a3ce9a9c04acd51b307/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_) 2023-07-11 14:11:10,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dhbp13l7f7kgr1ipe2lkbvhka1bsqdccnjo28b3u62448cf6og2iq1o74tt4a8b6/family1/9d0b691f6e5f48adb497fdf881cbc4a2 2023-07-11 14:11:10,258 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:10,259 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:10,263 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6099a2e818a425ab6c7a0150e18d4c6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6099a2e818a425ab6c7a0150e18d4c6 2023-07-11 14:11:10,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512057312196d7eaa4be291e6291c6a8c832a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512057312196d7eaa4be291e6291c6a8c832a 2023-07-11 14:11:10,266 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285311ebac38c64cc3882b5141c3b4685c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285311ebac38c64cc3882b5141c3b4685c 2023-07-11 14:11:10,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c193a0ccdb704957bf5459df2343a603 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c193a0ccdb704957bf5459df2343a603 2023-07-11 14:11:10,268 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-07-11 14:11:10,268 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-07-11 14:11:10,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:10,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:10,635 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/42c0b6e21421415d9f347154925222d6 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/42c0b6e21421415d9f347154925222d6 2023-07-11 14:11:10,646 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a38c5bec39018a3ce9a9c04acd51b307/family1 of a38c5bec39018a3ce9a9c04acd51b307 into 42c0b6e21421415d9f347154925222d6(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:11:10,647 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:10,647 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1689084669944; duration=0sec 2023-07-11 14:11:10,647 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:11:10,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/b1a58491ea5f42ce8f12cde6507ca709, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/c9b7f40ac9cc4c24933589f43e0d3173, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4f6d5d8a99184c7f95b91f58851d9fa1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/12b379ed40f845068c1227ccb7c9e4c4, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/15cb1dec96d04e46b3c4b2f403ba5e63, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39e3d52ba7e945d6977858df6437263f, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/7934eced2c004255a37de53e5928dbf8, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4b927e2a25ba4594ac420cee0046fed6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/f541c89219d04550bc7063661c304ddc, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_] to archive 2023-07-11 14:11:10,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:10,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/b1a58491ea5f42ce8f12cde6507ca709 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/b1a58491ea5f42ce8f12cde6507ca709 2023-07-11 14:11:10,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/c9b7f40ac9cc4c24933589f43e0d3173 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/c9b7f40ac9cc4c24933589f43e0d3173 2023-07-11 14:11:10,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4f6d5d8a99184c7f95b91f58851d9fa1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4f6d5d8a99184c7f95b91f58851d9fa1 2023-07-11 14:11:10,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/12b379ed40f845068c1227ccb7c9e4c4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/12b379ed40f845068c1227ccb7c9e4c4 2023-07-11 14:11:10,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/15cb1dec96d04e46b3c4b2f403ba5e63 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/15cb1dec96d04e46b3c4b2f403ba5e63 2023-07-11 14:11:10,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39e3d52ba7e945d6977858df6437263f to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39e3d52ba7e945d6977858df6437263f 2023-07-11 14:11:10,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/7934eced2c004255a37de53e5928dbf8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/7934eced2c004255a37de53e5928dbf8 2023-07-11 14:11:10,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4b927e2a25ba4594ac420cee0046fed6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4b927e2a25ba4594ac420cee0046fed6 2023-07-11 14:11:10,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/f541c89219d04550bc7063661c304ddc to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/f541c89219d04550bc7063661c304ddc 2023-07-11 14:11:10,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/850152ef04a948d2849cd3f900a1c697_SeqId_44_ 2023-07-11 14:11:10,742 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301f4e29a9dc9542fd9c1989406b970e72 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301f4e29a9dc9542fd9c1989406b970e72 2023-07-11 14:11:10,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:10,794 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cc1c489c7ad243fbaf093dba196be3f8 first=Optional[r00] last=Optional[r8] 2023-07-11 14:11:10,795 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cc1c489c7ad243fbaf093dba196be3f8}] 2023-07-11 14:11:10,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cc1c489c7ad243fbaf093dba196be3f8 for inclusion in a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:10,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-07-11 14:11:10,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 14:11:10,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:10,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cc1c489c7ad243fbaf093dba196be3f8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d4079v7pttfi4e806dvh3h69d50pb44cva92esi2ds5g1798gajjhsfjc8iebds3/family1/cc1c489c7ad243fbaf093dba196be3f8 2023-07-11 14:11:10,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d4079v7pttfi4e806dvh3h69d50pb44cva92esi2ds5g1798gajjhsfjc8iebds3/family1/cc1c489c7ad243fbaf093dba196be3f8 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_ 2023-07-11 14:11:10,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d4079v7pttfi4e806dvh3h69d50pb44cva92esi2ds5g1798gajjhsfjc8iebds3/family1/cc1c489c7ad243fbaf093dba196be3f8 into a38c5bec39018a3ce9a9c04acd51b307/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_ - updating store file list. 2023-07-11 14:11:10,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_ into a38c5bec39018a3ce9a9c04acd51b307/family1 2023-07-11 14:11:10,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d4079v7pttfi4e806dvh3h69d50pb44cva92esi2ds5g1798gajjhsfjc8iebds3/family1/cc1c489c7ad243fbaf093dba196be3f8 into a38c5bec39018a3ce9a9c04acd51b307/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_) 2023-07-11 14:11:10,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d4079v7pttfi4e806dvh3h69d50pb44cva92esi2ds5g1798gajjhsfjc8iebds3/family1/cc1c489c7ad243fbaf093dba196be3f8 2023-07-11 14:11:10,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 14:11:10,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 14:11:10,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(1912): a38c5bec39018a3ce9a9c04acd51b307/family1 is initiating minor compaction (all files) 2023-07-11 14:11:10,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1dd0d731; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:11:10,813 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a38c5bec39018a3ce9a9c04acd51b307/family1 in testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:10,813 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/0442a974e426466eaa6db26a65feb26c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/42c0b6e21421415d9f347154925222d6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp, totalSize=344.3 K 2023-07-11 14:11:10,813 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 0442a974e426466eaa6db26a65feb26c, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878818110 2023-07-11 14:11:10,814 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 42c0b6e21421415d9f347154925222d6, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621218110 2023-07-11 14:11:10,814 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting 39f4d3d12f63433da443376c693b471b_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965218110 2023-07-11 14:11:10,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:10,815 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] compactions.Compactor(207): Compacting ec6f23466caa45af898f13e2db6d5daf_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014818110 2023-07-11 14:11:10,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:10,817 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203c669c84aa064c3287eeb41c351aeacf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203c669c84aa064c3287eeb41c351aeacf 2023-07-11 14:11:10,818 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112804843c0c56904c4db16149749ab40fe8 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112804843c0c56904c4db16149749ab40fe8 2023-07-11 14:11:10,819 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130185148af3446470294f6aac0c39015af to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130185148af3446470294f6aac0c39015af 2023-07-11 14:11:10,819 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-07-11 14:11:10,819 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 14:11:10,820 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:10,820 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:10,820 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 14:11:10,820 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 14:11:10,820 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:11:10,822 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 14:11:10,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.5140 sec 2023-07-11 14:11:10,862 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] throttle.PressureAwareThroughputController(145): a38c5bec39018a3ce9a9c04acd51b307#family1#compaction#167 average throughput is 4.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:10,886 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/.tmp/family1/4279d4b196a244c88d251ab675eff9a1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/4279d4b196a244c88d251ab675eff9a1 2023-07-11 14:11:10,896 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a38c5bec39018a3ce9a9c04acd51b307/family1 of a38c5bec39018a3ce9a9c04acd51b307 into 4279d4b196a244c88d251ab675eff9a1(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:11:10,896 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:10,896 INFO [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1689084670813; duration=0sec 2023-07-11 14:11:10,896 DEBUG [RS:0;jenkins-hbase9:46743-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 14:11:10,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/0442a974e426466eaa6db26a65feb26c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/42c0b6e21421415d9f347154925222d6, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_] to archive 2023-07-11 14:11:10,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:10,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/0442a974e426466eaa6db26a65feb26c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/0442a974e426466eaa6db26a65feb26c 2023-07-11 14:11:10,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/42c0b6e21421415d9f347154925222d6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/42c0b6e21421415d9f347154925222d6 2023-07-11 14:11:10,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/39f4d3d12f63433da443376c693b471b_SeqId_46_ 2023-07-11 14:11:10,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_ to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/family1/ec6f23466caa45af898f13e2db6d5daf_SeqId_49_ 2023-07-11 14:11:11,231 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=262 (was 253) - Thread LEAK? -, OpenFileDescriptor=652 (was 636) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=607 (was 573) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1213 (was 1450) 2023-07-11 14:11:11,249 INFO [Listener at localhost/44533] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=261, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=607, ProcessCount=181, AvailableMemoryMB=1213 2023-07-11 14:11:11,303 DEBUG [Listener at localhost/44533] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-07-11 14:11:11,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x13\x03\xE2\xE3\x00*\xDA\x1C\x89e2@\x89\x8Bk/"\x10\x0F\xC0Z{W\x1C\x91NR\xD9D V\xA2\xF4\xD0*\x10\x8F\x88\xA8\xD9\x83\xFA0d\xEA\x96}Xs\xC3\xB3\xCF2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 14:11:11,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-07-11 14:11:11,405 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:11:11,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-07-11 14:11:11,405 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:11:11,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 14:11:11,409 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:11,411 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2 empty. 2023-07-11 14:11:11,411 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:11,411 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:11,411 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:11,412 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51 empty. 2023-07-11 14:11:11,412 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f empty. 2023-07-11 14:11:11,412 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:11,412 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:11,412 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-07-11 14:11:11,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 14:11:11,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 14:11:11,829 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-07-11 14:11:11,830 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => ebe3dc4896728810a1d5741d772aa9e2, NAME => 'testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x13\x03\xE2\xE3\x00*\xDA\x1C\x89e2@\x89\x8Bk/"\x10\x0F\xC0Z{W\x1C\x91NR\xD9D V\xA2\xF4\xD0*\x10\x8F\x88\xA8\xD9\x83\xFA0d\xEA\x96}Xs\xC3\xB3\xCF2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:11:11,832 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7158549b0272ab43bee85f0cb9833f51, NAME => 'testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x13\x03\xE2\xE3\x00*\xDA\x1C\x89e2@\x89\x8Bk/"\x10\x0F\xC0Z{W\x1C\x91NR\xD9D V\xA2\xF4\xD0*\x10\x8F\x88\xA8\xD9\x83\xFA0d\xEA\x96}Xs\xC3\xB3\xCF2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:11:11,833 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 23194586652360cd6cf8f7dc58c2233f, NAME => 'testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x13\x03\xE2\xE3\x00*\xDA\x1C\x89e2@\x89\x8Bk/"\x10\x0F\xC0Z{W\x1C\x91NR\xD9D V\xA2\xF4\xD0*\x10\x8F\x88\xA8\xD9\x83\xFA0d\xEA\x96}Xs\xC3\xB3\xCF2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/.tmp 2023-07-11 14:11:11,846 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:11,846 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 23194586652360cd6cf8f7dc58c2233f, disabling compactions & flushes 2023-07-11 14:11:11,846 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:11,846 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:11,846 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. after waiting 0 ms 2023-07-11 14:11:11,846 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:11,846 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:11,846 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:12,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 14:11:12,240 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:12,240 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing ebe3dc4896728810a1d5741d772aa9e2, disabling compactions & flushes 2023-07-11 14:11:12,240 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:12,240 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:12,240 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. after waiting 0 ms 2023-07-11 14:11:12,240 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:12,240 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:12,240 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:12,246 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:12,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 7158549b0272ab43bee85f0cb9833f51, disabling compactions & flushes 2023-07-11 14:11:12,247 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:12,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:12,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. after waiting 0 ms 2023-07-11 14:11:12,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:12,247 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:12,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:12,249 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:11:12,250 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084672250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084672250"}]},"ts":"1689084672250"} 2023-07-11 14:11:12,250 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084672250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084672250"}]},"ts":"1689084672250"} 2023-07-11 14:11:12,250 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689084672250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689084672250"}]},"ts":"1689084672250"} 2023-07-11 14:11:12,252 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 14:11:12,253 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:11:12,253 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084672253"}]},"ts":"1689084672253"} 2023-07-11 14:11:12,254 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-07-11 14:11:12,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ebe3dc4896728810a1d5741d772aa9e2, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7158549b0272ab43bee85f0cb9833f51, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=23194586652360cd6cf8f7dc58c2233f, ASSIGN}] 2023-07-11 14:11:12,259 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=23194586652360cd6cf8f7dc58c2233f, ASSIGN 2023-07-11 14:11:12,259 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7158549b0272ab43bee85f0cb9833f51, ASSIGN 2023-07-11 14:11:12,259 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ebe3dc4896728810a1d5741d772aa9e2, ASSIGN 2023-07-11 14:11:12,259 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=23194586652360cd6cf8f7dc58c2233f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:11:12,260 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7158549b0272ab43bee85f0cb9833f51, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:11:12,260 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ebe3dc4896728810a1d5741d772aa9e2, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46743,1689084553537; forceNewPlan=false, retain=false 2023-07-11 14:11:12,411 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=23194586652360cd6cf8f7dc58c2233f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:12,411 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7158549b0272ab43bee85f0cb9833f51, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:12,411 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ebe3dc4896728810a1d5741d772aa9e2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:12,411 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084672411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084672411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084672411"}]},"ts":"1689084672411"} 2023-07-11 14:11:12,411 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689084672411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084672411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084672411"}]},"ts":"1689084672411"} 2023-07-11 14:11:12,411 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084672411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689084672411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689084672411"}]},"ts":"1689084672411"} 2023-07-11 14:11:12,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 23194586652360cd6cf8f7dc58c2233f, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:11:12,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 7158549b0272ab43bee85f0cb9833f51, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:11:12,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure ebe3dc4896728810a1d5741d772aa9e2, server=jenkins-hbase9.apache.org,46743,1689084553537}] 2023-07-11 14:11:12,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 14:11:12,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:12,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ebe3dc4896728810a1d5741d772aa9e2, NAME => 'testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 14:11:12,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:12,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,594 INFO [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,600 DEBUG [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1 2023-07-11 14:11:12,600 DEBUG [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1 2023-07-11 14:11:12,600 INFO [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ebe3dc4896728810a1d5741d772aa9e2 columnFamilyName family1 2023-07-11 14:11:12,602 INFO [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] regionserver.HStore(310): Store=ebe3dc4896728810a1d5741d772aa9e2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:11:12,602 INFO [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,603 DEBUG [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2 2023-07-11 14:11:12,603 DEBUG [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2 2023-07-11 14:11:12,603 INFO [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ebe3dc4896728810a1d5741d772aa9e2 columnFamilyName family2 2023-07-11 14:11:12,605 INFO [StoreOpener-ebe3dc4896728810a1d5741d772aa9e2-1] regionserver.HStore(310): Store=ebe3dc4896728810a1d5741d772aa9e2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:11:12,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:11:12,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:12,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:11:12,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ebe3dc4896728810a1d5741d772aa9e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67214588, jitterRate=0.0015754103660583496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:11:12,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:12,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2., pid=122, masterSystemTime=1689084672564 2023-07-11 14:11:12,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:12,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:12,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:12,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7158549b0272ab43bee85f0cb9833f51, NAME => 'testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 14:11:12,616 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ebe3dc4896728810a1d5741d772aa9e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:12,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:12,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084672616"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084672616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084672616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084672616"}]},"ts":"1689084672616"} 2023-07-11 14:11:12,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-07-11 14:11:12,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure ebe3dc4896728810a1d5741d772aa9e2, server=jenkins-hbase9.apache.org,46743,1689084553537 in 203 msec 2023-07-11 14:11:12,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ebe3dc4896728810a1d5741d772aa9e2, ASSIGN in 363 msec 2023-07-11 14:11:12,644 INFO [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,645 DEBUG [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1 2023-07-11 14:11:12,645 DEBUG [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1 2023-07-11 14:11:12,646 INFO [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7158549b0272ab43bee85f0cb9833f51 columnFamilyName family1 2023-07-11 14:11:12,647 INFO [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] regionserver.HStore(310): Store=7158549b0272ab43bee85f0cb9833f51/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:11:12,647 INFO [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,648 DEBUG [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2 2023-07-11 14:11:12,648 DEBUG [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2 2023-07-11 14:11:12,649 INFO [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7158549b0272ab43bee85f0cb9833f51 columnFamilyName family2 2023-07-11 14:11:12,650 INFO [StoreOpener-7158549b0272ab43bee85f0cb9833f51-1] regionserver.HStore(310): Store=7158549b0272ab43bee85f0cb9833f51/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:11:12,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:11:12,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:12,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:11:12,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7158549b0272ab43bee85f0cb9833f51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62426498, jitterRate=-0.06977269053459167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:11:12,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:12,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51., pid=121, masterSystemTime=1689084672564 2023-07-11 14:11:12,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:12,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:12,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 23194586652360cd6cf8f7dc58c2233f, NAME => 'testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 14:11:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:11:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,660 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7158549b0272ab43bee85f0cb9833f51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:12,660 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689084672660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084672660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084672660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084672660"}]},"ts":"1689084672660"} 2023-07-11 14:11:12,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-07-11 14:11:12,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 7158549b0272ab43bee85f0cb9833f51, server=jenkins-hbase9.apache.org,46743,1689084553537 in 252 msec 2023-07-11 14:11:12,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7158549b0272ab43bee85f0cb9833f51, ASSIGN in 414 msec 2023-07-11 14:11:12,692 INFO [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,693 DEBUG [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1 2023-07-11 14:11:12,694 DEBUG [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1 2023-07-11 14:11:12,694 INFO [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23194586652360cd6cf8f7dc58c2233f columnFamilyName family1 2023-07-11 14:11:12,695 INFO [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] regionserver.HStore(310): Store=23194586652360cd6cf8f7dc58c2233f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:11:12,695 INFO [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,697 DEBUG [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2 2023-07-11 14:11:12,697 DEBUG [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2 2023-07-11 14:11:12,698 INFO [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23194586652360cd6cf8f7dc58c2233f columnFamilyName family2 2023-07-11 14:11:12,699 INFO [StoreOpener-23194586652360cd6cf8f7dc58c2233f-1] regionserver.HStore(310): Store=23194586652360cd6cf8f7dc58c2233f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:11:12,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 14:11:12,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:12,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:11:12,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 23194586652360cd6cf8f7dc58c2233f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61146805, jitterRate=-0.08884160220623016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 14:11:12,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:12,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f., pid=120, masterSystemTime=1689084672564 2023-07-11 14:11:12,708 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=23194586652360cd6cf8f7dc58c2233f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:12,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:12,708 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689084672708"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689084672708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689084672708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689084672708"}]},"ts":"1689084672708"} 2023-07-11 14:11:12,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:12,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-07-11 14:11:12,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 23194586652360cd6cf8f7dc58c2233f, server=jenkins-hbase9.apache.org,46743,1689084553537 in 296 msec 2023-07-11 14:11:12,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-07-11 14:11:12,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=23194586652360cd6cf8f7dc58c2233f, ASSIGN in 454 msec 2023-07-11 14:11:12,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:11:12,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689084672713"}]},"ts":"1689084672713"} 2023-07-11 14:11:12,716 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-07-11 14:11:12,718 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:11:12,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3160 sec 2023-07-11 14:11:13,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 14:11:13,513 INFO [Listener at localhost/44533] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-07-11 14:11:13,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:13,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:13,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:13,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:13,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 14:11:13,529 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 14:11:13,529 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:13,529 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 14:11:13,529 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 14:11:13,529 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:13,529 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:13,530 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:13,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:13,531 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:13,531 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:13,531 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:13,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:13,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 14:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 14:11:13,532 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 14:11:13,532 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:13,532 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 14:11:13,532 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:13,532 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. started... 2023-07-11 14:11:13,532 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:13,533 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. started... 2023-07-11 14:11:13,533 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:11:13,533 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:13,533 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 23194586652360cd6cf8f7dc58c2233f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:11:13,533 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:13,533 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebe3dc4896728810a1d5741d772aa9e2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:11:13,533 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. started... 2023-07-11 14:11:13,534 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7158549b0272ab43bee85f0cb9833f51 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 14:11:13,600 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711e743705816b14b9ba10a356ad73230ca to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711e743705816b14b9ba10a356ad73230ca 2023-07-11 14:11:14,001 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711bf0d03e262bb44aa9cb1e282b7d885b5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711bf0d03e262bb44aa9cb1e282b7d885b5 2023-07-11 14:11:14,008 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711c7ef9ccefbab4c5e8a422f4d89f10712 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711c7ef9ccefbab4c5e8a422f4d89f10712 2023-07-11 14:11:14,026 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/73f3bf84775246d98ff578d247ee4b31 2023-07-11 14:11:14,056 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/179e7d47228e417cb464735420ead8c9 2023-07-11 14:11:14,101 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c4111dcb7aa9439886c7cd15c416b589 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230711c4111dcb7aa9439886c7cd15c416b589 2023-07-11 14:11:14,441 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/d5eb23e2b2bd489b892ec5468ec42a65 2023-07-11 14:11:14,487 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711fb21e25dbcac42479c140a4be25f60ae to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230711fb21e25dbcac42479c140a4be25f60ae 2023-07-11 14:11:14,516 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/0a9d78d122a1477bb6128203288e23fb 2023-07-11 14:11:14,516 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711515b0d9fad2942a8969ac1663450a666 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230711515b0d9fad2942a8969ac1663450a666 2023-07-11 14:11:14,521 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/73f3bf84775246d98ff578d247ee4b31 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/73f3bf84775246d98ff578d247ee4b31 2023-07-11 14:11:14,521 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/1c1318d150c446e2b58f11440b6cd918 2023-07-11 14:11:14,526 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/179e7d47228e417cb464735420ead8c9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/179e7d47228e417cb464735420ead8c9 2023-07-11 14:11:14,552 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/73f3bf84775246d98ff578d247ee4b31, entries=4, sequenceid=5, filesize=5.5 K 2023-07-11 14:11:14,553 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/0a9d78d122a1477bb6128203288e23fb as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/0a9d78d122a1477bb6128203288e23fb 2023-07-11 14:11:14,556 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/179e7d47228e417cb464735420ead8c9, entries=4, sequenceid=5, filesize=5.5 K 2023-07-11 14:11:14,558 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/1c1318d150c446e2b58f11440b6cd918 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/1c1318d150c446e2b58f11440b6cd918 2023-07-11 14:11:14,560 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/0a9d78d122a1477bb6128203288e23fb, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:11:14,560 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7158549b0272ab43bee85f0cb9833f51 in 1026ms, sequenceid=5, compaction requested=false 2023-07-11 14:11:14,561 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-07-11 14:11:14,561 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:14,561 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:14,561 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:11:14,563 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/1c1318d150c446e2b58f11440b6cd918, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:11:14,564 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 23194586652360cd6cf8f7dc58c2233f in 1031ms, sequenceid=5, compaction requested=false 2023-07-11 14:11:14,569 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:14,569 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:14,569 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:11:14,893 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/1c19afa5c881463881e66015f9ffa5d1 2023-07-11 14:11:14,897 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/d5eb23e2b2bd489b892ec5468ec42a65 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/d5eb23e2b2bd489b892ec5468ec42a65 2023-07-11 14:11:14,935 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:11:14,935 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30e02836 to 127.0.0.1:63702 2023-07-11 14:11:14,935 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:14,935 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:11:14,936 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04ed70f3 to 127.0.0.1:63702 2023-07-11 14:11:14,936 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:14,957 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/d5eb23e2b2bd489b892ec5468ec42a65, entries=4, sequenceid=5, filesize=5.5 K 2023-07-11 14:11:14,958 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/1c19afa5c881463881e66015f9ffa5d1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/1c19afa5c881463881e66015f9ffa5d1 2023-07-11 14:11:14,962 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/1c19afa5c881463881e66015f9ffa5d1, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 14:11:14,963 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ebe3dc4896728810a1d5741d772aa9e2 in 1430ms, sequenceid=5, compaction requested=false 2023-07-11 14:11:14,963 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:14,963 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:14,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:11:14,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:11:14,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 14:11:14,963 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 14:11:14,969 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,969 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:14,969 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,969 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:14,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 14:11:14,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b773ccc[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:14,971 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 14:11:14,971 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,974 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,974 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 14:11:14,974 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 14:11:14,974 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:14,974 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,974 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:14,976 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,976 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 14:11:14,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:14,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:14,976 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:14,976 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 14:11:14,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:14,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:14,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:14,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:14,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 14:11:14,982 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 14:11:14,982 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:14,982 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:14,982 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 14:11:14,982 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:14,984 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:14,984 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:14,985 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:14,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:14,985 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:14,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:14,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:14,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:14,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:14,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:14,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:14,988 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:14,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:14,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,991 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,991 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:14,991 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:14,991 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:14,991 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:14,992 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:14,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:14,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 14:11:14,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:14,992 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:14,992 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 14:11:14,992 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:14,992 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:14,992 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:14,992 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:14,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:14,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:15,093 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:15,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:15,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:15,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:15,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:15,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:15,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:15,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 14:11:15,102 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 14:11:15,102 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:15,102 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 14:11:15,102 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 14:11:15,103 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:15,103 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:15,104 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:15,104 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:15,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:15,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:15,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:15,105 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:15,105 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:15,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:15,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 14:11:15,106 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 14:11:15,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 14:11:15,106 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 14:11:15,106 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:15,106 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 14:11:15,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:15,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. started... 2023-07-11 14:11:15,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:15,107 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:11:15,107 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebe3dc4896728810a1d5741d772aa9e2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:11:15,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:15,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. started... 2023-07-11 14:11:15,107 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. started... 2023-07-11 14:11:15,107 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 23194586652360cd6cf8f7dc58c2233f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:11:15,107 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7158549b0272ab43bee85f0cb9833f51 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 14:11:15,107 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:15,162 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307118d07865d4abf45a68dc63417f57c3149 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307118d07865d4abf45a68dc63417f57c3149 2023-07-11 14:11:15,167 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711af84efbd26fe4f398c2c089f648f381b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711af84efbd26fe4f398c2c089f648f381b 2023-07-11 14:11:15,181 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/800e3cc1a08c4373a79639d52abe20c1 2023-07-11 14:11:15,186 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/766b084eda004d7da26ffcf2b3f30e50 2023-07-11 14:11:15,566 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711e0c723430b3c43119845289190aff2fb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e0c723430b3c43119845289190aff2fb 2023-07-11 14:11:15,623 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071112852f3c16804e48bcfb1ac3cbd80091 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023071112852f3c16804e48bcfb1ac3cbd80091 2023-07-11 14:11:15,633 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/2e3c28b81d8a425e9e01ad41c0940f5b 2023-07-11 14:11:15,634 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307118e2f86c1c3804028a0c2b9816dd46db9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202307118e2f86c1c3804028a0c2b9816dd46db9 2023-07-11 14:11:15,636 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/800e3cc1a08c4373a79639d52abe20c1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/800e3cc1a08c4373a79639d52abe20c1 2023-07-11 14:11:15,664 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/800e3cc1a08c4373a79639d52abe20c1, entries=4, sequenceid=9, filesize=5.5 K 2023-07-11 14:11:15,664 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/2e3c28b81d8a425e9e01ad41c0940f5b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/2e3c28b81d8a425e9e01ad41c0940f5b 2023-07-11 14:11:15,668 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/2e3c28b81d8a425e9e01ad41c0940f5b, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:11:15,668 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 23194586652360cd6cf8f7dc58c2233f in 561ms, sequenceid=9, compaction requested=false 2023-07-11 14:11:15,669 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:15,669 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:15,669 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:11:15,980 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/8c922d24122e4d74b9206ac5607b5e51 2023-07-11 14:11:16,039 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/a88716648ab94df5a28749b7569b7ebf 2023-07-11 14:11:16,044 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/766b084eda004d7da26ffcf2b3f30e50 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/766b084eda004d7da26ffcf2b3f30e50 2023-07-11 14:11:16,070 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/766b084eda004d7da26ffcf2b3f30e50, entries=4, sequenceid=9, filesize=5.5 K 2023-07-11 14:11:16,070 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/a88716648ab94df5a28749b7569b7ebf as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/a88716648ab94df5a28749b7569b7ebf 2023-07-11 14:11:16,074 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/a88716648ab94df5a28749b7569b7ebf, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:11:16,075 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7158549b0272ab43bee85f0cb9833f51 in 968ms, sequenceid=9, compaction requested=false 2023-07-11 14:11:16,075 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:16,075 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:16,075 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:11:16,418 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307110f751388467e4b968e4d186b87979e11 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202307110f751388467e4b968e4d186b87979e11 2023-07-11 14:11:16,447 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/e49916f0bfe4499eba7ed556a9b569e3 2023-07-11 14:11:16,455 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/8c922d24122e4d74b9206ac5607b5e51 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/8c922d24122e4d74b9206ac5607b5e51 2023-07-11 14:11:16,499 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/8c922d24122e4d74b9206ac5607b5e51, entries=4, sequenceid=9, filesize=5.5 K 2023-07-11 14:11:16,501 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/e49916f0bfe4499eba7ed556a9b569e3 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/e49916f0bfe4499eba7ed556a9b569e3 2023-07-11 14:11:16,510 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/e49916f0bfe4499eba7ed556a9b569e3, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 14:11:16,512 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ebe3dc4896728810a1d5741d772aa9e2 in 1405ms, sequenceid=9, compaction requested=false 2023-07-11 14:11:16,512 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:16,512 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:16,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:11:16,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:11:16,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,513 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 14:11:16,513 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 14:11:16,515 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,515 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:16,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:16,515 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,515 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:16,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:16,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:16,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:16,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 14:11:16,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769731df[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:16,518 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 14:11:16,519 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,520 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,520 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 14:11:16,520 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 14:11:16,520 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:16,520 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,520 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:16,522 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 14:11:16,522 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,522 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:16,523 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 14:11:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:16,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:16,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:16,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:16,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:16,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:16,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 14:11:16,527 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 14:11:16,527 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:16,527 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:16,527 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 14:11:16,527 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:16,529 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,529 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:16,529 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:16,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:16,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:16,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:16,531 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:16,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:16,537 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:16,543 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:16,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 14:11:16,544 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:16,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 14:11:16,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:16,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:16,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:16,545 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:16,545 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:16,645 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:16,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:16,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:16,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:16,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:16,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:16,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:16,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 14:11:16,664 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 14:11:16,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:16,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 14:11:16,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 14:11:16,664 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,665 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:16,667 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:16,667 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:16,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:16,668 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:16,668 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:16,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:16,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:16,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:16,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:16,669 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 14:11:16,669 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 14:11:16,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 14:11:16,669 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 14:11:16,670 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:16,670 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 14:11:16,670 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:16,670 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. started... 2023-07-11 14:11:16,670 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebe3dc4896728810a1d5741d772aa9e2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:11:16,671 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:16,671 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. started... 2023-07-11 14:11:16,671 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 23194586652360cd6cf8f7dc58c2233f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:11:16,672 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:11:16,672 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:16,672 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:16,672 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. started... 2023-07-11 14:11:16,673 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7158549b0272ab43bee85f0cb9833f51 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 14:11:16,869 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711bf1d23de07f04d1c885d9142ba8b8df5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711bf1d23de07f04d1c885d9142ba8b8df5 2023-07-11 14:11:16,904 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/4def99f1fab94c4cbc9648204c5872b9 2023-07-11 14:11:17,250 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711e9062b743a384edeaeef3e43afcbb3e6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e9062b743a384edeaeef3e43afcbb3e6 2023-07-11 14:11:17,261 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711e2d5d8ca701240a6a709630f55e030b6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711e2d5d8ca701240a6a709630f55e030b6 2023-07-11 14:11:17,293 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/72c3a48bb3e047fbb0541e69efae1d75 2023-07-11 14:11:17,388 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711aba4dabd6c474134bf5732902102a383 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230711aba4dabd6c474134bf5732902102a383 2023-07-11 14:11:17,426 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/76e966c737924dd99d0909b095b1995c 2023-07-11 14:11:17,429 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307116c3f8583f1b2480ca4d70d54466b3db7 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202307116c3f8583f1b2480ca4d70d54466b3db7 2023-07-11 14:11:17,436 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/72c3a48bb3e047fbb0541e69efae1d75 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/72c3a48bb3e047fbb0541e69efae1d75 2023-07-11 14:11:17,469 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/afe2fc87db004258a00067d675e9a4e2 2023-07-11 14:11:17,475 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/4def99f1fab94c4cbc9648204c5872b9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/4def99f1fab94c4cbc9648204c5872b9 2023-07-11 14:11:17,488 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/72c3a48bb3e047fbb0541e69efae1d75, entries=4, sequenceid=13, filesize=5.5 K 2023-07-11 14:11:17,489 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/76e966c737924dd99d0909b095b1995c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/76e966c737924dd99d0909b095b1995c 2023-07-11 14:11:17,497 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/76e966c737924dd99d0909b095b1995c, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:11:17,499 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ebe3dc4896728810a1d5741d772aa9e2 in 829ms, sequenceid=13, compaction requested=true 2023-07-11 14:11:17,499 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:17,499 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:17,499 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:11:17,541 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/4def99f1fab94c4cbc9648204c5872b9, entries=4, sequenceid=13, filesize=5.5 K 2023-07-11 14:11:17,542 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/afe2fc87db004258a00067d675e9a4e2 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/afe2fc87db004258a00067d675e9a4e2 2023-07-11 14:11:17,551 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/afe2fc87db004258a00067d675e9a4e2, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:11:17,552 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7158549b0272ab43bee85f0cb9833f51 in 880ms, sequenceid=13, compaction requested=true 2023-07-11 14:11:17,552 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:17,552 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:17,552 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:11:17,772 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/27e8c267c5ec4d6792f764763ef11eeb 2023-07-11 14:11:18,070 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:11:18,323 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711d527048e8ce24e969022cf46d5df9716 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230711d527048e8ce24e969022cf46d5df9716 2023-07-11 14:11:18,331 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/ac716e4afa734dfba4bb79aa8c0da74c 2023-07-11 14:11:18,335 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/27e8c267c5ec4d6792f764763ef11eeb as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/27e8c267c5ec4d6792f764763ef11eeb 2023-07-11 14:11:18,360 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/27e8c267c5ec4d6792f764763ef11eeb, entries=4, sequenceid=13, filesize=5.5 K 2023-07-11 14:11:18,361 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/ac716e4afa734dfba4bb79aa8c0da74c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ac716e4afa734dfba4bb79aa8c0da74c 2023-07-11 14:11:18,365 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ac716e4afa734dfba4bb79aa8c0da74c, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 14:11:18,366 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 23194586652360cd6cf8f7dc58c2233f in 1695ms, sequenceid=13, compaction requested=true 2023-07-11 14:11:18,366 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:18,367 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:18,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:11:18,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:11:18,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 14:11:18,367 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 14:11:18,368 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,368 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:18,369 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,369 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:18,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 14:11:18,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4024ecc4[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:18,371 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 14:11:18,371 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,376 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,376 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 14:11:18,376 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 14:11:18,376 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:18,378 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 14:11:18,378 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:18,378 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 14:11:18,384 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,384 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 14:11:18,384 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:18,384 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 14:11:18,385 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:18,385 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:18,385 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 14:11:18,385 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:18,387 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,387 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:18,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:18,388 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:18,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:18,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:18,387 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:18,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:18,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:18,389 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:18,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:18,392 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:18,392 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:18,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:18,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:18,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:18,393 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,394 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:18,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 14:11:18,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:18,394 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:18,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 14:11:18,494 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:18,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:18,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:18,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:18,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 14:11:18,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:18,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:18,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 14:11:18,501 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 14:11:18,501 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:18,501 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 14:11:18,501 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 14:11:18,502 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,502 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:18,506 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:18,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:18,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:18,507 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:18,507 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:18,507 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:18,508 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 14:11:18,508 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 14:11:18,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 14:11:18,508 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 14:11:18,508 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:18,508 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 14:11:18,508 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:18,508 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. started... 2023-07-11 14:11:18,508 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:18,508 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. started... 2023-07-11 14:11:18,509 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 23194586652360cd6cf8f7dc58c2233f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:11:18,509 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebe3dc4896728810a1d5741d772aa9e2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:11:18,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:11:18,512 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:18,512 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:18,512 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. started... 2023-07-11 14:11:18,513 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7158549b0272ab43bee85f0cb9833f51 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 14:11:18,598 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307112a3fcecfb8bb41e28b4833f00d8607be to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307112a3fcecfb8bb41e28b4833f00d8607be 2023-07-11 14:11:18,611 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711b6c0a3f9438e4f9ea36b29de0a9cc525 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711b6c0a3f9438e4f9ea36b29de0a9cc525 2023-07-11 14:11:18,619 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/bf1f4183fb374f3bba7131d6513b6059 2023-07-11 14:11:18,977 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071180cee2a39f794ab6b377eaa667e5f62d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023071180cee2a39f794ab6b377eaa667e5f62d 2023-07-11 14:11:19,032 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/18feb4acb6b949149085422671253f65 2023-07-11 14:11:19,064 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307115bc1c28a035d44b88904533b9925f6c0 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202307115bc1c28a035d44b88904533b9925f6c0 2023-07-11 14:11:19,391 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/6c565adee0e14934a8dc49defc1de4b1 2023-07-11 14:11:19,464 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711666cec82b77246a794d274cacfb5a16b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230711666cec82b77246a794d274cacfb5a16b 2023-07-11 14:11:19,468 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/f0548ff72bf74aa98d11461042937353 2023-07-11 14:11:19,472 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/bf1f4183fb374f3bba7131d6513b6059 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/bf1f4183fb374f3bba7131d6513b6059 2023-07-11 14:11:19,495 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/bf1f4183fb374f3bba7131d6513b6059, entries=4, sequenceid=17, filesize=5.5 K 2023-07-11 14:11:19,496 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/f0548ff72bf74aa98d11461042937353 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/f0548ff72bf74aa98d11461042937353 2023-07-11 14:11:19,499 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/f0548ff72bf74aa98d11461042937353, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:11:19,500 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ebe3dc4896728810a1d5741d772aa9e2 in 992ms, sequenceid=17, compaction requested=true 2023-07-11 14:11:19,500 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:19,500 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:19,500 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:11:19,824 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711415f4e11dad64c1c81671d0dfecc18bd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230711415f4e11dad64c1c81671d0dfecc18bd 2023-07-11 14:11:19,870 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/9f602b28f91d4e01b92b41a5a41237b5 2023-07-11 14:11:19,875 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/18feb4acb6b949149085422671253f65 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/18feb4acb6b949149085422671253f65 2023-07-11 14:11:19,901 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/18feb4acb6b949149085422671253f65, entries=4, sequenceid=17, filesize=5.5 K 2023-07-11 14:11:19,902 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/9f602b28f91d4e01b92b41a5a41237b5 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/9f602b28f91d4e01b92b41a5a41237b5 2023-07-11 14:11:19,906 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/9f602b28f91d4e01b92b41a5a41237b5, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:11:19,907 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 23194586652360cd6cf8f7dc58c2233f in 1399ms, sequenceid=17, compaction requested=true 2023-07-11 14:11:19,907 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:19,907 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:19,907 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:11:20,230 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/fdea66d1d9864a8cb11df42dd670d8e1 2023-07-11 14:11:20,236 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/6c565adee0e14934a8dc49defc1de4b1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/6c565adee0e14934a8dc49defc1de4b1 2023-07-11 14:11:20,278 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/6c565adee0e14934a8dc49defc1de4b1, entries=4, sequenceid=17, filesize=5.5 K 2023-07-11 14:11:20,279 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/fdea66d1d9864a8cb11df42dd670d8e1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/fdea66d1d9864a8cb11df42dd670d8e1 2023-07-11 14:11:20,291 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/fdea66d1d9864a8cb11df42dd670d8e1, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 14:11:20,293 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7158549b0272ab43bee85f0cb9833f51 in 1779ms, sequenceid=17, compaction requested=true 2023-07-11 14:11:20,293 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:20,293 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:20,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:11:20,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:11:20,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 14:11:20,293 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 14:11:20,295 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,295 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:20,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,296 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:20,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:20,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:20,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 14:11:20,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@726dc33d[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:20,298 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 14:11:20,298 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,300 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,301 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,301 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:20,301 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 14:11:20,301 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 14:11:20,301 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:20,303 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 14:11:20,303 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:20,303 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 14:11:20,303 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:20,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 14:11:20,306 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 14:11:20,307 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:20,307 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:20,307 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 14:11:20,307 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:20,309 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,309 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:20,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,310 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:20,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:20,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,311 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:20,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:20,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:20,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,317 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:20,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:20,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:20,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:20,321 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,322 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,322 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:20,322 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,322 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:20,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 14:11:20,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:20,322 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:20,322 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:20,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:20,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:20,322 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:20,322 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:20,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:20,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:20,423 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:20,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:20,438 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:20,450 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:20,462 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:20,463 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:20,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 14:11:20,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 14:11:20,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 14:11:20,568 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 14:11:20,568 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:20,568 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 14:11:20,568 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 14:11:20,569 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,569 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:20,570 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:20,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:20,570 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:20,570 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:20,570 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 14:11:20,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:20,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 14:11:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:20,571 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 14:11:20,571 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 14:11:20,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 14:11:20,571 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 14:11:20,572 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 14:11:20,572 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 14:11:20,572 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:20,572 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:20,572 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 14:11:20,572 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 14:11:20,572 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. started... 2023-07-11 14:11:20,572 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:20,572 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. started... 2023-07-11 14:11:20,572 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 23194586652360cd6cf8f7dc58c2233f 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:11:20,572 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. started... 2023-07-11 14:11:20,572 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebe3dc4896728810a1d5741d772aa9e2 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:11:20,572 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7158549b0272ab43bee85f0cb9833f51 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 14:11:20,621 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/bb10b3729e8c44a6913b73b9607ff035 2023-07-11 14:11:20,645 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb10b3729e8c44a6913b73b9607ff035 2023-07-11 14:11:20,654 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/bf3e54e62b134d689b23bd945273bb7b 2023-07-11 14:11:20,657 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf3e54e62b134d689b23bd945273bb7b 2023-07-11 14:11:20,658 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/bb10b3729e8c44a6913b73b9607ff035 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/bb10b3729e8c44a6913b73b9607ff035 2023-07-11 14:11:20,682 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb10b3729e8c44a6913b73b9607ff035 2023-07-11 14:11:20,682 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/bb10b3729e8c44a6913b73b9607ff035, entries=3, sequenceid=23, filesize=5.2 K 2023-07-11 14:11:20,682 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/bf3e54e62b134d689b23bd945273bb7b as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/bf3e54e62b134d689b23bd945273bb7b 2023-07-11 14:11:20,686 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf3e54e62b134d689b23bd945273bb7b 2023-07-11 14:11:20,686 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/bf3e54e62b134d689b23bd945273bb7b, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 14:11:20,687 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7158549b0272ab43bee85f0cb9833f51 in 115ms, sequenceid=23, compaction requested=true 2023-07-11 14:11:20,687 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:20,687 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:20,687 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 14:11:21,019 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/0f2577d9850744b39cbf9c8fb017daaa 2023-07-11 14:11:21,020 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/c4280352d9934783a10198c72717f814 2023-07-11 14:11:21,054 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f2577d9850744b39cbf9c8fb017daaa 2023-07-11 14:11:21,054 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4280352d9934783a10198c72717f814 2023-07-11 14:11:21,467 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a 2023-07-11 14:11:21,470 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab91fc0ebc4e46ce9ddb543bbec8e74a 2023-07-11 14:11:21,470 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/c4280352d9934783a10198c72717f814 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/c4280352d9934783a10198c72717f814 2023-07-11 14:11:21,493 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4280352d9934783a10198c72717f814 2023-07-11 14:11:21,493 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/c4280352d9934783a10198c72717f814, entries=3, sequenceid=23, filesize=5.2 K 2023-07-11 14:11:21,494 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a 2023-07-11 14:11:21,497 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab91fc0ebc4e46ce9ddb543bbec8e74a 2023-07-11 14:11:21,497 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 14:11:21,497 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 23194586652360cd6cf8f7dc58c2233f in 925ms, sequenceid=23, compaction requested=true 2023-07-11 14:11:21,497 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:21,497 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:21,497 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 14:11:21,866 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/321e529e624e4c6aa6eee4f36e9e6729 2023-07-11 14:11:21,870 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 321e529e624e4c6aa6eee4f36e9e6729 2023-07-11 14:11:21,871 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/0f2577d9850744b39cbf9c8fb017daaa as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/0f2577d9850744b39cbf9c8fb017daaa 2023-07-11 14:11:21,895 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f2577d9850744b39cbf9c8fb017daaa 2023-07-11 14:11:21,895 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/0f2577d9850744b39cbf9c8fb017daaa, entries=3, sequenceid=23, filesize=5.2 K 2023-07-11 14:11:21,896 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/321e529e624e4c6aa6eee4f36e9e6729 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/321e529e624e4c6aa6eee4f36e9e6729 2023-07-11 14:11:21,900 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 321e529e624e4c6aa6eee4f36e9e6729 2023-07-11 14:11:21,900 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/321e529e624e4c6aa6eee4f36e9e6729, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 14:11:21,901 INFO [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ebe3dc4896728810a1d5741d772aa9e2 in 1329ms, sequenceid=23, compaction requested=true 2023-07-11 14:11:21,901 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:21,901 DEBUG [rs(jenkins-hbase9.apache.org,46743,1689084553537)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:21,901 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 14:11:21,901 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 14:11:21,901 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,901 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 14:11:21,901 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 14:11:21,903 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,903 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:21,903 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,903 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 14:11:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:21,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:21,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:21,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:21,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46743,1689084553537' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 14:11:21,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707e00e0[Count = 0] remaining members to acquire global barrier 2023-07-11 14:11:21,905 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 14:11:21,905 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,907 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,907 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 14:11:21,907 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 14:11:21,907 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,46743,1689084553537' in zk 2023-07-11 14:11:21,907 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,907 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 14:11:21,908 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 14:11:21,908 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,908 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:21,908 DEBUG [member: 'jenkins-hbase9.apache.org,46743,1689084553537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 14:11:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:21,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,46743,1689084553537': 2023-07-11 14:11:21,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46743,1689084553537' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 14:11:21,910 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 14:11:21,910 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 14:11:21,910 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 14:11:21,910 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 14:11:21,910 INFO [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 14:11:21,911 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:21,911 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:21,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:21,911 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:21,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 14:11:21,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 14:11:21,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:21,912 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:21,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 14:11:21,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:21,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:21,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 14:11:21,913 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:21,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 14:11:21,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:21,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 14:11:21,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 14:11:21,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 14:11:21,915 DEBUG [(jenkins-hbase9.apache.org,33029,1689084552049)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 14:11:21,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 14:11:21,915 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 14:11:21,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 14:11:21,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:11:22,015 DEBUG [Listener at localhost/44533] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 14:11:22,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33029] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 14:11:22,017 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:11:22,017 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): ebe3dc4896728810a1d5741d772aa9e2/family1 is initiating major compaction (all files) 2023-07-11 14:11:22,017 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:11:22,017 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:11:22,017 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of ebe3dc4896728810a1d5741d772aa9e2/family1 in testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:22,018 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/d5eb23e2b2bd489b892ec5468ec42a65, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/8c922d24122e4d74b9206ac5607b5e51, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/72c3a48bb3e047fbb0541e69efae1d75, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/bf1f4183fb374f3bba7131d6513b6059, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/0f2577d9850744b39cbf9c8fb017daaa] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp, totalSize=27.1 K 2023-07-11 14:11:22,018 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting d5eb23e2b2bd489b892ec5468ec42a65, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084673524 2023-07-11 14:11:22,019 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 8c922d24122e4d74b9206ac5607b5e51, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084675095 2023-07-11 14:11:22,019 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 72c3a48bb3e047fbb0541e69efae1d75, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084676648 2023-07-11 14:11:22,020 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting bf1f4183fb374f3bba7131d6513b6059, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084678497 2023-07-11 14:11:22,020 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 0f2577d9850744b39cbf9c8fb017daaa, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:11:22,039 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): ebe3dc4896728810a1d5741d772aa9e2#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:22,483 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711e9f956b14723493181643d478d21da81_del 2023-07-11 14:11:22,484 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711e9f956b14723493181643d478d21da81_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e9f956b14723493181643d478d21da81_del 2023-07-11 14:11:22,549 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fc178d2caa14c48be40c4876087f5b7 2023-07-11 14:11:22,550 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family1/7fc178d2caa14c48be40c4876087f5b7 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/7fc178d2caa14c48be40c4876087f5b7 2023-07-11 14:11:22,584 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fc178d2caa14c48be40c4876087f5b7 2023-07-11 14:11:22,585 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ebe3dc4896728810a1d5741d772aa9e2/family1 of ebe3dc4896728810a1d5741d772aa9e2 into 7fc178d2caa14c48be40c4876087f5b7(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:11:22,586 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:22,586 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:11:22,586 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): ebe3dc4896728810a1d5741d772aa9e2/family2 is initiating major compaction (all files) 2023-07-11 14:11:22,586 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:11:22,586 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:11:22,586 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of ebe3dc4896728810a1d5741d772aa9e2/family2 in testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:22,586 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/1c19afa5c881463881e66015f9ffa5d1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/e49916f0bfe4499eba7ed556a9b569e3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/76e966c737924dd99d0909b095b1995c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/f0548ff72bf74aa98d11461042937353, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/321e529e624e4c6aa6eee4f36e9e6729] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp, totalSize=25.4 K 2023-07-11 14:11:22,587 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 1c19afa5c881463881e66015f9ffa5d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084673524 2023-07-11 14:11:22,587 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting e49916f0bfe4499eba7ed556a9b569e3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084675095 2023-07-11 14:11:22,588 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 76e966c737924dd99d0909b095b1995c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084676648 2023-07-11 14:11:22,588 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting f0548ff72bf74aa98d11461042937353, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084678497 2023-07-11 14:11:22,588 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 321e529e624e4c6aa6eee4f36e9e6729, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:11:22,597 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): ebe3dc4896728810a1d5741d772aa9e2#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:22,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/d5eb23e2b2bd489b892ec5468ec42a65, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/8c922d24122e4d74b9206ac5607b5e51, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/72c3a48bb3e047fbb0541e69efae1d75, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/bf1f4183fb374f3bba7131d6513b6059, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/0f2577d9850744b39cbf9c8fb017daaa] to archive 2023-07-11 14:11:22,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:22,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/d5eb23e2b2bd489b892ec5468ec42a65 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/d5eb23e2b2bd489b892ec5468ec42a65 2023-07-11 14:11:22,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/8c922d24122e4d74b9206ac5607b5e51 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/8c922d24122e4d74b9206ac5607b5e51 2023-07-11 14:11:22,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/72c3a48bb3e047fbb0541e69efae1d75 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/72c3a48bb3e047fbb0541e69efae1d75 2023-07-11 14:11:22,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/bf1f4183fb374f3bba7131d6513b6059 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/bf1f4183fb374f3bba7131d6513b6059 2023-07-11 14:11:22,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/0f2577d9850744b39cbf9c8fb017daaa to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/0f2577d9850744b39cbf9c8fb017daaa 2023-07-11 14:11:22,610 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711e757ee8e805044b5835ea31b9b1ad143_del 2023-07-11 14:11:22,611 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711e757ee8e805044b5835ea31b9b1ad143_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230711e757ee8e805044b5835ea31b9b1ad143_del 2023-07-11 14:11:22,636 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62982dd12b0449ffa787a85ce9c65483 2023-07-11 14:11:22,636 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/.tmp/family2/62982dd12b0449ffa787a85ce9c65483 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/62982dd12b0449ffa787a85ce9c65483 2023-07-11 14:11:22,640 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62982dd12b0449ffa787a85ce9c65483 2023-07-11 14:11:22,641 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ebe3dc4896728810a1d5741d772aa9e2/family2 of ebe3dc4896728810a1d5741d772aa9e2 into 62982dd12b0449ffa787a85ce9c65483(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:11:22,642 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:22,642 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:11:22,642 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 23194586652360cd6cf8f7dc58c2233f/family1 is initiating major compaction (all files) 2023-07-11 14:11:22,642 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:11:22,642 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:11:22,643 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 23194586652360cd6cf8f7dc58c2233f/family1 in testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:22,643 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/179e7d47228e417cb464735420ead8c9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/800e3cc1a08c4373a79639d52abe20c1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/27e8c267c5ec4d6792f764763ef11eeb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/18feb4acb6b949149085422671253f65, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/c4280352d9934783a10198c72717f814] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp, totalSize=27.1 K 2023-07-11 14:11:22,643 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 179e7d47228e417cb464735420ead8c9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084673525 2023-07-11 14:11:22,643 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 800e3cc1a08c4373a79639d52abe20c1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084675095 2023-07-11 14:11:22,644 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 27e8c267c5ec4d6792f764763ef11eeb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084676648 2023-07-11 14:11:22,644 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 18feb4acb6b949149085422671253f65, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084678497 2023-07-11 14:11:22,645 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting c4280352d9934783a10198c72717f814, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:11:22,673 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 23194586652360cd6cf8f7dc58c2233f#family1#compaction#200 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:22,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/1c19afa5c881463881e66015f9ffa5d1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/e49916f0bfe4499eba7ed556a9b569e3, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/76e966c737924dd99d0909b095b1995c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/f0548ff72bf74aa98d11461042937353, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/321e529e624e4c6aa6eee4f36e9e6729] to archive 2023-07-11 14:11:22,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:22,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/1c19afa5c881463881e66015f9ffa5d1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/1c19afa5c881463881e66015f9ffa5d1 2023-07-11 14:11:22,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/e49916f0bfe4499eba7ed556a9b569e3 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/e49916f0bfe4499eba7ed556a9b569e3 2023-07-11 14:11:22,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/76e966c737924dd99d0909b095b1995c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/76e966c737924dd99d0909b095b1995c 2023-07-11 14:11:22,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/f0548ff72bf74aa98d11461042937353 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/f0548ff72bf74aa98d11461042937353 2023-07-11 14:11:22,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/321e529e624e4c6aa6eee4f36e9e6729 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family2/321e529e624e4c6aa6eee4f36e9e6729 2023-07-11 14:11:23,115 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307119f4df0be078d4656883d7c0f8e68eaf1_del 2023-07-11 14:11:23,116 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307119f4df0be078d4656883d7c0f8e68eaf1_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307119f4df0be078d4656883d7c0f8e68eaf1_del 2023-07-11 14:11:23,975 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8565abb88c2f466f936910ed25f2022c 2023-07-11 14:11:23,976 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family1/8565abb88c2f466f936910ed25f2022c as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/8565abb88c2f466f936910ed25f2022c 2023-07-11 14:11:24,010 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8565abb88c2f466f936910ed25f2022c 2023-07-11 14:11:24,011 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 23194586652360cd6cf8f7dc58c2233f/family1 of 23194586652360cd6cf8f7dc58c2233f into 8565abb88c2f466f936910ed25f2022c(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 14:11:24,011 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:24,011 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:11:24,012 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 23194586652360cd6cf8f7dc58c2233f/family2 is initiating major compaction (all files) 2023-07-11 14:11:24,012 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:11:24,012 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:11:24,014 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 23194586652360cd6cf8f7dc58c2233f/family2 in testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:24,014 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/1c1318d150c446e2b58f11440b6cd918, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/2e3c28b81d8a425e9e01ad41c0940f5b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ac716e4afa734dfba4bb79aa8c0da74c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/9f602b28f91d4e01b92b41a5a41237b5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp, totalSize=25.4 K 2023-07-11 14:11:24,017 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 1c1318d150c446e2b58f11440b6cd918, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084673525 2023-07-11 14:11:24,017 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 2e3c28b81d8a425e9e01ad41c0940f5b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084675095 2023-07-11 14:11:24,019 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting ac716e4afa734dfba4bb79aa8c0da74c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084676648 2023-07-11 14:11:24,020 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 9f602b28f91d4e01b92b41a5a41237b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084678497 2023-07-11 14:11:24,021 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting ab91fc0ebc4e46ce9ddb543bbec8e74a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:11:24,045 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 23194586652360cd6cf8f7dc58c2233f#family2#compaction#201 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:24,061 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307113a673b2431d44b889b5d71c666e1fd85_del 2023-07-11 14:11:24,061 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307113a673b2431d44b889b5d71c666e1fd85_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202307113a673b2431d44b889b5d71c666e1fd85_del 2023-07-11 14:11:24,091 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c215ec2a692e4a60a84ba85e420959e7 2023-07-11 14:11:24,092 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/.tmp/family2/c215ec2a692e4a60a84ba85e420959e7 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/c215ec2a692e4a60a84ba85e420959e7 2023-07-11 14:11:24,095 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c215ec2a692e4a60a84ba85e420959e7 2023-07-11 14:11:24,096 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 23194586652360cd6cf8f7dc58c2233f/family2 of 23194586652360cd6cf8f7dc58c2233f into c215ec2a692e4a60a84ba85e420959e7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:11:24,096 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:24,096 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:11:24,097 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 7158549b0272ab43bee85f0cb9833f51/family1 is initiating major compaction (all files) 2023-07-11 14:11:24,097 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:11:24,097 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:11:24,097 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 7158549b0272ab43bee85f0cb9833f51/family1 in testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:24,097 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/73f3bf84775246d98ff578d247ee4b31, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/766b084eda004d7da26ffcf2b3f30e50, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/4def99f1fab94c4cbc9648204c5872b9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/6c565adee0e14934a8dc49defc1de4b1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/bb10b3729e8c44a6913b73b9607ff035] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp, totalSize=27.1 K 2023-07-11 14:11:24,097 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 73f3bf84775246d98ff578d247ee4b31, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084673525 2023-07-11 14:11:24,098 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 766b084eda004d7da26ffcf2b3f30e50, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084675095 2023-07-11 14:11:24,098 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 4def99f1fab94c4cbc9648204c5872b9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084676648 2023-07-11 14:11:24,098 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 6c565adee0e14934a8dc49defc1de4b1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084678497 2023-07-11 14:11:24,099 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting bb10b3729e8c44a6913b73b9607ff035, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:11:24,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/179e7d47228e417cb464735420ead8c9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/800e3cc1a08c4373a79639d52abe20c1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/27e8c267c5ec4d6792f764763ef11eeb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/18feb4acb6b949149085422671253f65, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/c4280352d9934783a10198c72717f814] to archive 2023-07-11 14:11:24,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:24,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/179e7d47228e417cb464735420ead8c9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/179e7d47228e417cb464735420ead8c9 2023-07-11 14:11:24,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/800e3cc1a08c4373a79639d52abe20c1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/800e3cc1a08c4373a79639d52abe20c1 2023-07-11 14:11:24,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/27e8c267c5ec4d6792f764763ef11eeb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/27e8c267c5ec4d6792f764763ef11eeb 2023-07-11 14:11:24,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/18feb4acb6b949149085422671253f65 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/18feb4acb6b949149085422671253f65 2023-07-11 14:11:24,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/c4280352d9934783a10198c72717f814 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/c4280352d9934783a10198c72717f814 2023-07-11 14:11:24,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/1c1318d150c446e2b58f11440b6cd918, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/2e3c28b81d8a425e9e01ad41c0940f5b, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ac716e4afa734dfba4bb79aa8c0da74c, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/9f602b28f91d4e01b92b41a5a41237b5, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a] to archive 2023-07-11 14:11:24,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:24,108 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 7158549b0272ab43bee85f0cb9833f51#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:24,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/1c1318d150c446e2b58f11440b6cd918 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/1c1318d150c446e2b58f11440b6cd918 2023-07-11 14:11:24,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/2e3c28b81d8a425e9e01ad41c0940f5b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/2e3c28b81d8a425e9e01ad41c0940f5b 2023-07-11 14:11:24,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ac716e4afa734dfba4bb79aa8c0da74c to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ac716e4afa734dfba4bb79aa8c0da74c 2023-07-11 14:11:24,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/9f602b28f91d4e01b92b41a5a41237b5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/9f602b28f91d4e01b92b41a5a41237b5 2023-07-11 14:11:24,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family2/ab91fc0ebc4e46ce9ddb543bbec8e74a 2023-07-11 14:11:24,563 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711233ffc2c4da24461b35cdad79e801bd3_del 2023-07-11 14:11:24,563 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711233ffc2c4da24461b35cdad79e801bd3_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711233ffc2c4da24461b35cdad79e801bd3_del 2023-07-11 14:11:25,172 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a23817e4928240208afb099a43fc62ad 2023-07-11 14:11:25,173 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family1/a23817e4928240208afb099a43fc62ad as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/a23817e4928240208afb099a43fc62ad 2023-07-11 14:11:25,204 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a23817e4928240208afb099a43fc62ad 2023-07-11 14:11:25,205 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7158549b0272ab43bee85f0cb9833f51/family1 of 7158549b0272ab43bee85f0cb9833f51 into a23817e4928240208afb099a43fc62ad(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 14:11:25,205 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:25,205 DEBUG [Listener at localhost/44533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 14:11:25,205 DEBUG [Listener at localhost/44533] regionserver.HStore(1912): 7158549b0272ab43bee85f0cb9833f51/family2 is initiating major compaction (all files) 2023-07-11 14:11:25,206 INFO [Listener at localhost/44533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:11:25,206 INFO [Listener at localhost/44533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:11:25,207 INFO [Listener at localhost/44533] regionserver.HRegion(2259): Starting compaction of 7158549b0272ab43bee85f0cb9833f51/family2 in testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:25,207 INFO [Listener at localhost/44533] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/0a9d78d122a1477bb6128203288e23fb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/a88716648ab94df5a28749b7569b7ebf, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/afe2fc87db004258a00067d675e9a4e2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/fdea66d1d9864a8cb11df42dd670d8e1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/bf3e54e62b134d689b23bd945273bb7b] into tmpdir=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp, totalSize=25.4 K 2023-07-11 14:11:25,207 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting 0a9d78d122a1477bb6128203288e23fb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689084673525 2023-07-11 14:11:25,208 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting a88716648ab94df5a28749b7569b7ebf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689084675095 2023-07-11 14:11:25,208 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting afe2fc87db004258a00067d675e9a4e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689084676648 2023-07-11 14:11:25,208 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting fdea66d1d9864a8cb11df42dd670d8e1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689084678497 2023-07-11 14:11:25,209 DEBUG [Listener at localhost/44533] compactions.Compactor(207): Compacting bf3e54e62b134d689b23bd945273bb7b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 14:11:25,242 INFO [Listener at localhost/44533] throttle.PressureAwareThroughputController(145): 7158549b0272ab43bee85f0cb9833f51#family2#compaction#203 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 14:11:25,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/73f3bf84775246d98ff578d247ee4b31, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/766b084eda004d7da26ffcf2b3f30e50, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/4def99f1fab94c4cbc9648204c5872b9, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/6c565adee0e14934a8dc49defc1de4b1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/bb10b3729e8c44a6913b73b9607ff035] to archive 2023-07-11 14:11:25,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:25,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/73f3bf84775246d98ff578d247ee4b31 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/73f3bf84775246d98ff578d247ee4b31 2023-07-11 14:11:25,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/766b084eda004d7da26ffcf2b3f30e50 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/766b084eda004d7da26ffcf2b3f30e50 2023-07-11 14:11:25,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/4def99f1fab94c4cbc9648204c5872b9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/4def99f1fab94c4cbc9648204c5872b9 2023-07-11 14:11:25,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/6c565adee0e14934a8dc49defc1de4b1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/6c565adee0e14934a8dc49defc1de4b1 2023-07-11 14:11:25,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/bb10b3729e8c44a6913b73b9607ff035 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/bb10b3729e8c44a6913b73b9607ff035 2023-07-11 14:11:25,668 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023071150c7cafff0a34e5d8f046b39a289058e_del 2023-07-11 14:11:25,668 INFO [Listener at localhost/44533] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071150c7cafff0a34e5d8f046b39a289058e_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023071150c7cafff0a34e5d8f046b39a289058e_del 2023-07-11 14:11:26,094 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a467cccc453461ab1688ad9bec759f8 2023-07-11 14:11:26,094 DEBUG [Listener at localhost/44533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/.tmp/family2/8a467cccc453461ab1688ad9bec759f8 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/8a467cccc453461ab1688ad9bec759f8 2023-07-11 14:11:26,099 INFO [Listener at localhost/44533] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a467cccc453461ab1688ad9bec759f8 2023-07-11 14:11:26,100 INFO [Listener at localhost/44533] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7158549b0272ab43bee85f0cb9833f51/family2 of 7158549b0272ab43bee85f0cb9833f51 into 8a467cccc453461ab1688ad9bec759f8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 14:11:26,100 DEBUG [Listener at localhost/44533] regionserver.HRegion(2289): Compaction status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:26,105 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:26,108 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:26,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/0a9d78d122a1477bb6128203288e23fb, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/a88716648ab94df5a28749b7569b7ebf, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/afe2fc87db004258a00067d675e9a4e2, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/fdea66d1d9864a8cb11df42dd670d8e1, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/bf3e54e62b134d689b23bd945273bb7b] to archive 2023-07-11 14:11:26,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:26,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/0a9d78d122a1477bb6128203288e23fb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/0a9d78d122a1477bb6128203288e23fb 2023-07-11 14:11:26,112 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:26,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/a88716648ab94df5a28749b7569b7ebf to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/a88716648ab94df5a28749b7569b7ebf 2023-07-11 14:11:26,112 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:26,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/afe2fc87db004258a00067d675e9a4e2 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/afe2fc87db004258a00067d675e9a4e2 2023-07-11 14:11:26,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/fdea66d1d9864a8cb11df42dd670d8e1 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/fdea66d1d9864a8cb11df42dd670d8e1 2023-07-11 14:11:26,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/bf3e54e62b134d689b23bd945273bb7b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family2/bf3e54e62b134d689b23bd945273bb7b 2023-07-11 14:11:26,117 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33029] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x13\x03\xE2\xE3\x00*\xDA\x1C\x89e2@\x89\x8Bk/"\x10\x0F\xC0Z{W\x1C\x91NR\xD9D V\xA2\xF4\xD0*\x10\x8F\x88\xA8\xD9\x83\xFA0d\xEA\x96}Xs\xC3\xB3\xCF2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-07-11 14:11:26,138 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-11 14:11:26,139 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-11 14:11:26,139 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:11:26,139 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689085286139 2023-07-11 14:11:26,140 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 14:11:26,530 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-07-11 14:11:26,561 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711e9f956b14723493181643d478d21da81_del 2023-07-11 14:11:26,587 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711233ffc2c4da24461b35cdad79e801bd3_del 2023-07-11 14:11:26,611 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307119f4df0be078d4656883d7c0f8e68eaf1_del 2023-07-11 14:11:26,611 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:26,611 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] zookeeper.ReadOnlyZKClient(139): Connect 0x24607b79 to 127.0.0.1:63702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:11:26,616 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32345ae8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:11:26,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 14:11:27,568 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071110a515f9bb4743e391e3fd6c5a7c3b32 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071110a515f9bb4743e391e3fd6c5a7c3b32 2023-07-11 14:11:27,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:27,583 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:11:27,585 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:11:27,593 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:11:27,595 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:11:27,623 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/96be88bc12c14232963614b62a8f7cf9 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-07-11 14:11:27,624 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/96be88bc12c14232963614b62a8f7cf9}] 2023-07-11 14:11:27,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/96be88bc12c14232963614b62a8f7cf9 for inclusion in ebe3dc4896728810a1d5741d772aa9e2/family1 2023-07-11 14:11:27,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-07-11 14:11:27,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 14:11:27,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:27,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/96be88bc12c14232963614b62a8f7cf9 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__c22kb9hhvbkbgdstkbb4ru20mgc6qvqr032ab3ihk0cbbj7q8tep4a6h8vrl39t1/family1/96be88bc12c14232963614b62a8f7cf9 2023-07-11 14:11:27,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__c22kb9hhvbkbgdstkbb4ru20mgc6qvqr032ab3ihk0cbbj7q8tep4a6h8vrl39t1/family1/96be88bc12c14232963614b62a8f7cf9 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/5df09486faac4da7882a82e86d4d7d8e_SeqId_28_ 2023-07-11 14:11:27,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__c22kb9hhvbkbgdstkbb4ru20mgc6qvqr032ab3ihk0cbbj7q8tep4a6h8vrl39t1/family1/96be88bc12c14232963614b62a8f7cf9 into ebe3dc4896728810a1d5741d772aa9e2/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/5df09486faac4da7882a82e86d4d7d8e_SeqId_28_ - updating store file list. 2023-07-11 14:11:27,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/5df09486faac4da7882a82e86d4d7d8e_SeqId_28_ into ebe3dc4896728810a1d5741d772aa9e2/family1 2023-07-11 14:11:27,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__c22kb9hhvbkbgdstkbb4ru20mgc6qvqr032ab3ihk0cbbj7q8tep4a6h8vrl39t1/family1/96be88bc12c14232963614b62a8f7cf9 into ebe3dc4896728810a1d5741d772aa9e2/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/family1/5df09486faac4da7882a82e86d4d7d8e_SeqId_28_) 2023-07-11 14:11:27,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__c22kb9hhvbkbgdstkbb4ru20mgc6qvqr032ab3ihk0cbbj7q8tep4a6h8vrl39t1/family1/96be88bc12c14232963614b62a8f7cf9 2023-07-11 14:11:27,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:27,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:27,680 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307112a3fcecfb8bb41e28b4833f00d8607be to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307112a3fcecfb8bb41e28b4833f00d8607be 2023-07-11 14:11:27,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711bf0d03e262bb44aa9cb1e282b7d885b5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711bf0d03e262bb44aa9cb1e282b7d885b5 2023-07-11 14:11:27,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e0c723430b3c43119845289190aff2fb to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e0c723430b3c43119845289190aff2fb 2023-07-11 14:11:27,683 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e9062b743a384edeaeef3e43afcbb3e6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e9062b743a384edeaeef3e43afcbb3e6 2023-07-11 14:11:27,683 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-11 14:11:27,683 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 14:11:27,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 14:11:27,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 14:11:28,262 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711077b3f449cda44a48cd9fc54c94b3afd to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711077b3f449cda44a48cd9fc54c94b3afd 2023-07-11 14:11:28,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:28,311 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/b801def98e3c483787099897a25344f7 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-07-11 14:11:28,312 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/b801def98e3c483787099897a25344f7}] 2023-07-11 14:11:28,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/b801def98e3c483787099897a25344f7 for inclusion in 23194586652360cd6cf8f7dc58c2233f/family1 2023-07-11 14:11:28,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-07-11 14:11:28,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 14:11:28,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:28,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/b801def98e3c483787099897a25344f7 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__ioka56i8nab1ts7lc8i6lirv0rtuirrffsg9nj5ksu3i9em8gp2smk7em7atmigk/family1/b801def98e3c483787099897a25344f7 2023-07-11 14:11:28,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__ioka56i8nab1ts7lc8i6lirv0rtuirrffsg9nj5ksu3i9em8gp2smk7em7atmigk/family1/b801def98e3c483787099897a25344f7 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/679faf0a45864a05a6c65042e2256e48_SeqId_28_ 2023-07-11 14:11:28,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__ioka56i8nab1ts7lc8i6lirv0rtuirrffsg9nj5ksu3i9em8gp2smk7em7atmigk/family1/b801def98e3c483787099897a25344f7 into 23194586652360cd6cf8f7dc58c2233f/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/679faf0a45864a05a6c65042e2256e48_SeqId_28_ - updating store file list. 2023-07-11 14:11:28,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/679faf0a45864a05a6c65042e2256e48_SeqId_28_ into 23194586652360cd6cf8f7dc58c2233f/family1 2023-07-11 14:11:28,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__ioka56i8nab1ts7lc8i6lirv0rtuirrffsg9nj5ksu3i9em8gp2smk7em7atmigk/family1/b801def98e3c483787099897a25344f7 into 23194586652360cd6cf8f7dc58c2233f/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/family1/679faf0a45864a05a6c65042e2256e48_SeqId_28_) 2023-07-11 14:11:28,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__ioka56i8nab1ts7lc8i6lirv0rtuirrffsg9nj5ksu3i9em8gp2smk7em7atmigk/family1/b801def98e3c483787099897a25344f7 2023-07-11 14:11:28,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:28,367 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:28,369 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307118d07865d4abf45a68dc63417f57c3149 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307118d07865d4abf45a68dc63417f57c3149 2023-07-11 14:11:28,370 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711b6c0a3f9438e4f9ea36b29de0a9cc525 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711b6c0a3f9438e4f9ea36b29de0a9cc525 2023-07-11 14:11:28,371 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711c7ef9ccefbab4c5e8a422f4d89f10712 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711c7ef9ccefbab4c5e8a422f4d89f10712 2023-07-11 14:11:28,372 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711e2d5d8ca701240a6a709630f55e030b6 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711e2d5d8ca701240a6a709630f55e030b6 2023-07-11 14:11:28,372 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-11 14:11:28,372 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 14:11:28,373 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 14:11:28,373 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 14:11:28,552 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711323e412655204cbd9994d0ec87115200 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711323e412655204cbd9994d0ec87115200 2023-07-11 14:11:28,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:28,595 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/4cbb0f471a4c44619b6d383cf88487a4 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-07-11 14:11:28,595 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51., hostname=jenkins-hbase9.apache.org,46743,1689084553537, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/4cbb0f471a4c44619b6d383cf88487a4}] 2023-07-11 14:11:28,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(763): Validating hfile at hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/4cbb0f471a4c44619b6d383cf88487a4 for inclusion in 7158549b0272ab43bee85f0cb9833f51/family1 2023-07-11 14:11:28,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-07-11 14:11:28,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 14:11:28,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegion(2446): Flush status journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:28,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/4cbb0f471a4c44619b6d383cf88487a4 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__mn2k7odo2p7ghlfbi9bet0n3u6hcqqab59743jsomvipsvtd0jse1r2sbtgd402j/family1/4cbb0f471a4c44619b6d383cf88487a4 2023-07-11 14:11:28,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__mn2k7odo2p7ghlfbi9bet0n3u6hcqqab59743jsomvipsvtd0jse1r2sbtgd402j/family1/4cbb0f471a4c44619b6d383cf88487a4 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/2bb361b5a69f4eb5a3d5b64d2ac51ce7_SeqId_28_ 2023-07-11 14:11:28,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(849): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__mn2k7odo2p7ghlfbi9bet0n3u6hcqqab59743jsomvipsvtd0jse1r2sbtgd402j/family1/4cbb0f471a4c44619b6d383cf88487a4 into 7158549b0272ab43bee85f0cb9833f51/family1 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/2bb361b5a69f4eb5a3d5b64d2ac51ce7_SeqId_28_ - updating store file list. 2023-07-11 14:11:28,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(882): Loaded HFile hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/2bb361b5a69f4eb5a3d5b64d2ac51ce7_SeqId_28_ into 7158549b0272ab43bee85f0cb9833f51/family1 2023-07-11 14:11:28,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.HStore(855): Successfully loaded hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__mn2k7odo2p7ghlfbi9bet0n3u6hcqqab59743jsomvipsvtd0jse1r2sbtgd402j/family1/4cbb0f471a4c44619b6d383cf88487a4 into 7158549b0272ab43bee85f0cb9833f51/family1 (new location: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/family1/2bb361b5a69f4eb5a3d5b64d2ac51ce7_SeqId_28_) 2023-07-11 14:11:28,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46743] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/staging/jenkins__testMajorCompactionFromAdmin__mn2k7odo2p7ghlfbi9bet0n3u6hcqqab59743jsomvipsvtd0jse1r2sbtgd402j/family1/4cbb0f471a4c44619b6d383cf88487a4 2023-07-11 14:11:28,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:28,649 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:28,652 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023071180cee2a39f794ab6b377eaa667e5f62d to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023071180cee2a39f794ab6b377eaa667e5f62d 2023-07-11 14:11:28,653 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711af84efbd26fe4f398c2c089f648f381b to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711af84efbd26fe4f398c2c089f648f381b 2023-07-11 14:11:28,654 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711bf1d23de07f04d1c885d9142ba8b8df5 to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711bf1d23de07f04d1c885d9142ba8b8df5 2023-07-11 14:11:28,656 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711e743705816b14b9ba10a356ad73230ca to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711e743705816b14b9ba10a356ad73230ca 2023-07-11 14:11:28,656 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-11 14:11:28,656 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 14:11:28,657 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 14:11:28,657 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 14:11:28,657 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 14:11:28,657 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e9f956b14723493181643d478d21da81_del] 2023-07-11 14:11:28,657 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:28,659 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e9f956b14723493181643d478d21da81_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711e9f956b14723493181643d478d21da81_del 2023-07-11 14:11:28,659 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-11 14:11:28,659 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711233ffc2c4da24461b35cdad79e801bd3_del] 2023-07-11 14:11:28,660 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:28,662 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711233ffc2c4da24461b35cdad79e801bd3_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711233ffc2c4da24461b35cdad79e801bd3_del 2023-07-11 14:11:28,662 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-11 14:11:28,662 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307119f4df0be078d4656883d7c0f8e68eaf1_del] 2023-07-11 14:11:28,665 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 14:11:28,667 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307119f4df0be078d4656883d7c0f8e68eaf1_del to hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307119f4df0be078d4656883d7c0f8e68eaf1_del 2023-07-11 14:11:28,667 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-11 14:11:28,667 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689084557929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 14:11:28,668 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-11 14:11:28,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.5310 sec 2023-07-11 14:11:28,686 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:28,688 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:28,690 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 14:11:28,691 DEBUG [Listener at localhost/44533] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 14:11:28,696 INFO [Listener at localhost/44533] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:11:28,753 INFO [Listener at localhost/44533] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252 (was 261), OpenFileDescriptor=636 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=621 (was 607) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=470 (was 1213) 2023-07-11 14:11:28,754 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2802e06e to 127.0.0.1:63702 2023-07-11 14:11:28,754 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:28,754 INFO [Listener at localhost/44533] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 14:11:28,755 INFO [Listener at localhost/44533] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:11:28,755 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x799bfff6 to 127.0.0.1:63702 2023-07-11 14:11:28,755 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:28,755 DEBUG [Listener at localhost/44533] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 14:11:28,755 DEBUG [Listener at localhost/44533] util.JVMClusterUtil(257): Found active master hash=1213220201, stopped=false 2023-07-11 14:11:28,755 INFO [Listener at localhost/44533] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:11:28,759 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 14:11:28,759 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 14:11:28,759 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:11:28,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:11:28,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:11:28,761 INFO [Listener at localhost/44533] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:11:28,762 DEBUG [Listener at localhost/44533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x659a287b to 127.0.0.1:63702 2023-07-11 14:11:28,762 DEBUG [Listener at localhost/44533] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:28,762 INFO [Listener at localhost/44533] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,46743,1689084553537' ***** 2023-07-11 14:11:28,762 INFO [Listener at localhost/44533] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 14:11:28,762 INFO [RS:0;jenkins-hbase9:46743] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 14:11:28,763 INFO [RS:0;jenkins-hbase9:46743] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 14:11:28,763 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 14:11:28,763 INFO [RS:0;jenkins-hbase9:46743] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 14:11:28,763 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for d1dffee09ccc83fe54e67efb91e2730a 2023-07-11 14:11:28,764 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for fa4ceb102d347183576477762c1978f5 2023-07-11 14:11:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d1dffee09ccc83fe54e67efb91e2730a, disabling compactions & flushes 2023-07-11 14:11:28,764 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for a0fbb332649998fdb41b01ab9fc81edf 2023-07-11 14:11:28,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:11:28,764 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 7b4c3e810294b74f730a671a9718e5b5 2023-07-11 14:11:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:11:28,764 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for cec49ede7f05373b7ad17290ed0e3ae6 2023-07-11 14:11:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. after waiting 0 ms 2023-07-11 14:11:28,764 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for ede8be49db937c3a62b0dc3899496428 2023-07-11 14:11:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:11:28,764 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 5468830e11f70f9b65ff569cddc29953 2023-07-11 14:11:28,764 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for ebe3dc4896728810a1d5741d772aa9e2 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for b5454e394f36817f1220287023e7e6f8 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for cddba20831049118a1940b3fa858141f 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 46718097f9c05e645861136a4a7a8050 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 80765973aeda01239012c20bac5b9d83 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for a38c5bec39018a3ce9a9c04acd51b307 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for daba5eabb4b40fdec155cf1e437895d9 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for f398ea8794712f0784dc2726308bb40a 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 23194586652360cd6cf8f7dc58c2233f 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 9aaa666cabc8359a75b55d380a2e4fac 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for bcf670488a25fe6c22291cd6aac15c1e 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 7158549b0272ab43bee85f0cb9833f51 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 1a59eba5ceb1b37937c91647cca969e7 2023-07-11 14:11:28,765 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:28,765 DEBUG [RS:0;jenkins-hbase9:46743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bb93727 to 127.0.0.1:63702 2023-07-11 14:11:28,765 DEBUG [RS:0;jenkins-hbase9:46743] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:28,766 INFO [RS:0;jenkins-hbase9:46743] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 14:11:28,766 INFO [RS:0;jenkins-hbase9:46743] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 14:11:28,766 INFO [RS:0;jenkins-hbase9:46743] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 14:11:28,766 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 14:11:28,766 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-07-11 14:11:28,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 14:11:28,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 14:11:28,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 14:11:28,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 14:11:28,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 14:11:28,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-07-11 14:11:28,767 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1504): Waiting on 1588230740, 1a59eba5ceb1b37937c91647cca969e7, 23194586652360cd6cf8f7dc58c2233f, 46718097f9c05e645861136a4a7a8050, 5468830e11f70f9b65ff569cddc29953, 7158549b0272ab43bee85f0cb9833f51, 7b4c3e810294b74f730a671a9718e5b5, 80765973aeda01239012c20bac5b9d83, 9aaa666cabc8359a75b55d380a2e4fac, a0fbb332649998fdb41b01ab9fc81edf, a38c5bec39018a3ce9a9c04acd51b307, b5454e394f36817f1220287023e7e6f8, bcf670488a25fe6c22291cd6aac15c1e, cddba20831049118a1940b3fa858141f, cec49ede7f05373b7ad17290ed0e3ae6, d1dffee09ccc83fe54e67efb91e2730a, daba5eabb4b40fdec155cf1e437895d9, ebe3dc4896728810a1d5741d772aa9e2, ede8be49db937c3a62b0dc3899496428, f398ea8794712f0784dc2726308bb40a, fa4ceb102d347183576477762c1978f5 2023-07-11 14:11:28,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/d1dffee09ccc83fe54e67efb91e2730a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-11 14:11:28,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:11:28,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d1dffee09ccc83fe54e67efb91e2730a: 2023-07-11 14:11:28,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1689084626884.d1dffee09ccc83fe54e67efb91e2730a. 2023-07-11 14:11:28,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing fa4ceb102d347183576477762c1978f5, disabling compactions & flushes 2023-07-11 14:11:28,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/.tmp/info/bc34f4a4ca2d46b6b27045cdb47ce241 2023-07-11 14:11:28,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:11:28,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:11:28,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. after waiting 0 ms 2023-07-11 14:11:28,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:11:28,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc34f4a4ca2d46b6b27045cdb47ce241 2023-07-11 14:11:28,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/.tmp/rep_barrier/f16814de2e0d4a7c86b83630ac447420 2023-07-11 14:11:28,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/fa4ceb102d347183576477762c1978f5/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 14:11:28,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:11:28,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for fa4ceb102d347183576477762c1978f5: 2023-07-11 14:11:28,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1689084648368.fa4ceb102d347183576477762c1978f5. 2023-07-11 14:11:28,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a0fbb332649998fdb41b01ab9fc81edf, disabling compactions & flushes 2023-07-11 14:11:28,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:11:28,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:11:28,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. after waiting 0 ms 2023-07-11 14:11:28,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:11:28,802 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-11 14:11:28,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f16814de2e0d4a7c86b83630ac447420 2023-07-11 14:11:28,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithWeeklyPolicy/a0fbb332649998fdb41b01ab9fc81edf/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-11 14:11:28,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:11:28,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a0fbb332649998fdb41b01ab9fc81edf: 2023-07-11 14:11:28,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1689084577454.a0fbb332649998fdb41b01ab9fc81edf. 2023-07-11 14:11:28,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7b4c3e810294b74f730a671a9718e5b5, disabling compactions & flushes 2023-07-11 14:11:28,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:11:28,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:11:28,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. after waiting 0 ms 2023-07-11 14:11:28,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:11:28,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/7b4c3e810294b74f730a671a9718e5b5/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-11 14:11:28,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:11:28,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7b4c3e810294b74f730a671a9718e5b5: 2023-07-11 14:11:28,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1689084626884.7b4c3e810294b74f730a671a9718e5b5. 2023-07-11 14:11:28,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing cec49ede7f05373b7ad17290ed0e3ae6, disabling compactions & flushes 2023-07-11 14:11:28,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:11:28,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:11:28,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. after waiting 0 ms 2023-07-11 14:11:28,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:11:28,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing cec49ede7f05373b7ad17290ed0e3ae6 1/1 column families, dataSize=109 B heapSize=592 B 2023-07-11 14:11:28,857 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:11:28,967 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1504): Waiting on 1588230740, 1a59eba5ceb1b37937c91647cca969e7, 23194586652360cd6cf8f7dc58c2233f, 46718097f9c05e645861136a4a7a8050, 5468830e11f70f9b65ff569cddc29953, 7158549b0272ab43bee85f0cb9833f51, 80765973aeda01239012c20bac5b9d83, 9aaa666cabc8359a75b55d380a2e4fac, a38c5bec39018a3ce9a9c04acd51b307, b5454e394f36817f1220287023e7e6f8, bcf670488a25fe6c22291cd6aac15c1e, cddba20831049118a1940b3fa858141f, cec49ede7f05373b7ad17290ed0e3ae6, daba5eabb4b40fdec155cf1e437895d9, ebe3dc4896728810a1d5741d772aa9e2, ede8be49db937c3a62b0dc3899496428, f398ea8794712f0784dc2726308bb40a 2023-07-11 14:11:29,168 DEBUG [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1504): Waiting on 1588230740, 1a59eba5ceb1b37937c91647cca969e7, 23194586652360cd6cf8f7dc58c2233f, 46718097f9c05e645861136a4a7a8050, 5468830e11f70f9b65ff569cddc29953, 7158549b0272ab43bee85f0cb9833f51, 80765973aeda01239012c20bac5b9d83, 9aaa666cabc8359a75b55d380a2e4fac, a38c5bec39018a3ce9a9c04acd51b307, b5454e394f36817f1220287023e7e6f8, bcf670488a25fe6c22291cd6aac15c1e, cddba20831049118a1940b3fa858141f, cec49ede7f05373b7ad17290ed0e3ae6, daba5eabb4b40fdec155cf1e437895d9, ebe3dc4896728810a1d5741d772aa9e2, ede8be49db937c3a62b0dc3899496428, f398ea8794712f0784dc2726308bb40a 2023-07-11 14:11:29,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/.tmp/table/0dff26b2fd20466dae80922914ad79ff 2023-07-11 14:11:29,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dff26b2fd20466dae80922914ad79ff 2023-07-11 14:11:29,223 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/.tmp/info/bc34f4a4ca2d46b6b27045cdb47ce241 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/info/bc34f4a4ca2d46b6b27045cdb47ce241 2023-07-11 14:11:29,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc34f4a4ca2d46b6b27045cdb47ce241 2023-07-11 14:11:29,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/info/bc34f4a4ca2d46b6b27045cdb47ce241, entries=226, sequenceid=130, filesize=37.9 K 2023-07-11 14:11:29,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/.tmp/rep_barrier/f16814de2e0d4a7c86b83630ac447420 as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/rep_barrier/f16814de2e0d4a7c86b83630ac447420 2023-07-11 14:11:29,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f16814de2e0d4a7c86b83630ac447420 2023-07-11 14:11:29,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/rep_barrier/f16814de2e0d4a7c86b83630ac447420, entries=1, sequenceid=130, filesize=5.0 K 2023-07-11 14:11:29,231 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/.tmp/table/0dff26b2fd20466dae80922914ad79ff as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/table/0dff26b2fd20466dae80922914ad79ff 2023-07-11 14:11:29,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dff26b2fd20466dae80922914ad79ff 2023-07-11 14:11:29,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/table/0dff26b2fd20466dae80922914ad79ff, entries=27, sequenceid=130, filesize=6.6 K 2023-07-11 14:11:29,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 468ms, sequenceid=130, compaction requested=false 2023-07-11 14:11:29,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/.tmp/info/58e6b894c51c472a8228cbd5791f898e 2023-07-11 14:11:29,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-07-11 14:11:29,239 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 14:11:29,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 14:11:29,239 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 14:11:29,239 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 14:11:29,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/.tmp/info/58e6b894c51c472a8228cbd5791f898e as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/info/58e6b894c51c472a8228cbd5791f898e 2023-07-11 14:11:29,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/info/58e6b894c51c472a8228cbd5791f898e, entries=3, sequenceid=7, filesize=4.8 K 2023-07-11 14:11:29,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for cec49ede7f05373b7ad17290ed0e3ae6 in 419ms, sequenceid=7, compaction requested=false 2023-07-11 14:11:29,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/hbase/namespace/cec49ede7f05373b7ad17290ed0e3ae6/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-07-11 14:11:29,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:11:29,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for cec49ede7f05373b7ad17290ed0e3ae6: 2023-07-11 14:11:29,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689084556745.cec49ede7f05373b7ad17290ed0e3ae6. 2023-07-11 14:11:29,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ede8be49db937c3a62b0dc3899496428, disabling compactions & flushes 2023-07-11 14:11:29,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:11:29,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:11:29,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. after waiting 0 ms 2023-07-11 14:11:29,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:11:29,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ede8be49db937c3a62b0dc3899496428/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-07-11 14:11:29,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:11:29,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ede8be49db937c3a62b0dc3899496428: 2023-07-11 14:11:29,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689084612761.ede8be49db937c3a62b0dc3899496428. 2023-07-11 14:11:29,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5468830e11f70f9b65ff569cddc29953, disabling compactions & flushes 2023-07-11 14:11:29,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:11:29,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:11:29,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. after waiting 0 ms 2023-07-11 14:11:29,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:11:29,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5468830e11f70f9b65ff569cddc29953/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-07-11 14:11:29,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:11:29,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5468830e11f70f9b65ff569cddc29953: 2023-07-11 14:11:29,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689084558158.5468830e11f70f9b65ff569cddc29953. 2023-07-11 14:11:29,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ebe3dc4896728810a1d5741d772aa9e2, disabling compactions & flushes 2023-07-11 14:11:29,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:29,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:29,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. after waiting 0 ms 2023-07-11 14:11:29,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/ebe3dc4896728810a1d5741d772aa9e2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 14:11:29,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ebe3dc4896728810a1d5741d772aa9e2: 2023-07-11 14:11:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1689084671355.ebe3dc4896728810a1d5741d772aa9e2. 2023-07-11 14:11:29,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b5454e394f36817f1220287023e7e6f8, disabling compactions & flushes 2023-07-11 14:11:29,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:11:29,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:11:29,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. after waiting 0 ms 2023-07-11 14:11:29,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:11:29,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyPolicy/b5454e394f36817f1220287023e7e6f8/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-11 14:11:29,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:11:29,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b5454e394f36817f1220287023e7e6f8: 2023-07-11 14:11:29,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1689084589608.b5454e394f36817f1220287023e7e6f8. 2023-07-11 14:11:29,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing cddba20831049118a1940b3fa858141f, disabling compactions & flushes 2023-07-11 14:11:29,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:11:29,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:11:29,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. after waiting 0 ms 2023-07-11 14:11:29,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:11:29,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/cddba20831049118a1940b3fa858141f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-07-11 14:11:29,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:11:29,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for cddba20831049118a1940b3fa858141f: 2023-07-11 14:11:29,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1689084585896.cddba20831049118a1940b3fa858141f. 2023-07-11 14:11:29,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 46718097f9c05e645861136a4a7a8050, disabling compactions & flushes 2023-07-11 14:11:29,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:11:29,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:11:29,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. after waiting 0 ms 2023-07-11 14:11:29,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:11:29,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithMonthlyPolicy/46718097f9c05e645861136a4a7a8050/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-07-11 14:11:29,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:11:29,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 46718097f9c05e645861136a4a7a8050: 2023-07-11 14:11:29,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1689084568830.46718097f9c05e645861136a4a7a8050. 2023-07-11 14:11:29,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 80765973aeda01239012c20bac5b9d83, disabling compactions & flushes 2023-07-11 14:11:29,286 INFO [regionserver/jenkins-hbase9:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 14:11:29,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:11:29,286 INFO [regionserver/jenkins-hbase9:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 14:11:29,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:11:29,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. after waiting 0 ms 2023-07-11 14:11:29,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:11:29,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/80765973aeda01239012c20bac5b9d83/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-07-11 14:11:29,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:11:29,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 80765973aeda01239012c20bac5b9d83: 2023-07-11 14:11:29,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1689084585896.80765973aeda01239012c20bac5b9d83. 2023-07-11 14:11:29,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a38c5bec39018a3ce9a9c04acd51b307, disabling compactions & flushes 2023-07-11 14:11:29,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:29,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:29,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. after waiting 0 ms 2023-07-11 14:11:29,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:29,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMinorCompactionWithMonthlyPolicy/a38c5bec39018a3ce9a9c04acd51b307/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-07-11 14:11:29,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:29,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a38c5bec39018a3ce9a9c04acd51b307: 2023-07-11 14:11:29,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1689084661264.a38c5bec39018a3ce9a9c04acd51b307. 2023-07-11 14:11:29,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing daba5eabb4b40fdec155cf1e437895d9, disabling compactions & flushes 2023-07-11 14:11:29,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:11:29,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:11:29,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. after waiting 0 ms 2023-07-11 14:11:29,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:11:29,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/daba5eabb4b40fdec155cf1e437895d9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 14:11:29,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:11:29,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for daba5eabb4b40fdec155cf1e437895d9: 2023-07-11 14:11:29,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1689084648368.daba5eabb4b40fdec155cf1e437895d9. 2023-07-11 14:11:29,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f398ea8794712f0784dc2726308bb40a, disabling compactions & flushes 2023-07-11 14:11:29,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:11:29,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:11:29,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. after waiting 0 ms 2023-07-11 14:11:29,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:11:29,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f398ea8794712f0784dc2726308bb40a/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-07-11 14:11:29,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:11:29,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f398ea8794712f0784dc2726308bb40a: 2023-07-11 14:11:29,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689084599791.f398ea8794712f0784dc2726308bb40a. 2023-07-11 14:11:29,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 23194586652360cd6cf8f7dc58c2233f, disabling compactions & flushes 2023-07-11 14:11:29,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:29,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:29,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. after waiting 0 ms 2023-07-11 14:11:29,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:29,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/23194586652360cd6cf8f7dc58c2233f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 14:11:29,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 23194586652360cd6cf8f7dc58c2233f: 2023-07-11 14:11:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1689084671355.23194586652360cd6cf8f7dc58c2233f. 2023-07-11 14:11:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9aaa666cabc8359a75b55d380a2e4fac, disabling compactions & flushes 2023-07-11 14:11:29,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:11:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:11:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. after waiting 0 ms 2023-07-11 14:11:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:11:29,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testCompactionWithHFileLink/9aaa666cabc8359a75b55d380a2e4fac/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-11 14:11:29,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:11:29,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9aaa666cabc8359a75b55d380a2e4fac: 2023-07-11 14:11:29,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1689084626884.9aaa666cabc8359a75b55d380a2e4fac. 2023-07-11 14:11:29,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing bcf670488a25fe6c22291cd6aac15c1e, disabling compactions & flushes 2023-07-11 14:11:29,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:11:29,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:11:29,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. after waiting 0 ms 2023-07-11 14:11:29,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:11:29,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/ns/testMinorCompaction/bcf670488a25fe6c22291cd6aac15c1e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 14:11:29,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:11:29,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for bcf670488a25fe6c22291cd6aac15c1e: 2023-07-11 14:11:29,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1689084648368.bcf670488a25fe6c22291cd6aac15c1e. 2023-07-11 14:11:29,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7158549b0272ab43bee85f0cb9833f51, disabling compactions & flushes 2023-07-11 14:11:29,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:29,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:29,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. after waiting 0 ms 2023-07-11 14:11:29,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:29,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testMajorCompactionFromAdmin/7158549b0272ab43bee85f0cb9833f51/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 14:11:29,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:29,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7158549b0272ab43bee85f0cb9833f51: 2023-07-11 14:11:29,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1689084671355.7158549b0272ab43bee85f0cb9833f51. 2023-07-11 14:11:29,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1a59eba5ceb1b37937c91647cca969e7, disabling compactions & flushes 2023-07-11 14:11:29,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:11:29,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:11:29,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. after waiting 0 ms 2023-07-11 14:11:29,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:11:29,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/data/default/testScannerOnBulkLoadRefHFiles/1a59eba5ceb1b37937c91647cca969e7/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-07-11 14:11:29,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:11:29,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1a59eba5ceb1b37937c91647cca969e7: 2023-07-11 14:11:29,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1689084585896.1a59eba5ceb1b37937c91647cca969e7. 2023-07-11 14:11:29,368 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,46743,1689084553537; all regions closed. 2023-07-11 14:11:29,381 DEBUG [RS:0;jenkins-hbase9:46743] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/oldWALs 2023-07-11 14:11:29,381 INFO [RS:0;jenkins-hbase9:46743] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46743%2C1689084553537.meta:.meta(num 1689084556373) 2023-07-11 14:11:29,386 DEBUG [RS:0;jenkins-hbase9:46743] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/oldWALs 2023-07-11 14:11:29,386 INFO [RS:0;jenkins-hbase9:46743] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46743%2C1689084553537:(num 1689084555418) 2023-07-11 14:11:29,386 DEBUG [RS:0;jenkins-hbase9:46743] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:29,386 INFO [RS:0;jenkins-hbase9:46743] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:11:29,387 INFO [RS:0;jenkins-hbase9:46743] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 14:11:29,387 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 14:11:29,388 INFO [RS:0;jenkins-hbase9:46743] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46743 2023-07-11 14:11:29,396 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46743,1689084553537 2023-07-11 14:11:29,396 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:11:29,396 ERROR [Listener at localhost/44533-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@166d2f43 rejected from java.util.concurrent.ThreadPoolExecutor@1252b956[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-11 14:11:29,396 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:11:29,397 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,46743,1689084553537] 2023-07-11 14:11:29,397 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,46743,1689084553537; numProcessing=1 2023-07-11 14:11:29,399 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,46743,1689084553537 already deleted, retry=false 2023-07-11 14:11:29,400 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,46743,1689084553537 expired; onlineServers=0 2023-07-11 14:11:29,400 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33029,1689084552049' ***** 2023-07-11 14:11:29,400 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 14:11:29,400 DEBUG [M:0;jenkins-hbase9:33029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@96d4f52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 14:11:29,400 INFO [M:0;jenkins-hbase9:33029] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33029,1689084552049 2023-07-11 14:11:29,400 INFO [M:0;jenkins-hbase9:33029] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33029,1689084552049; all regions closed. 2023-07-11 14:11:29,400 DEBUG [M:0;jenkins-hbase9:33029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:11:29,401 DEBUG [M:0;jenkins-hbase9:33029] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 14:11:29,401 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 14:11:29,401 DEBUG [M:0;jenkins-hbase9:33029] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 14:11:29,401 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689084555015] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689084555015,5,FailOnTimeoutGroup] 2023-07-11 14:11:29,401 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689084555000] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689084555000,5,FailOnTimeoutGroup] 2023-07-11 14:11:29,401 INFO [M:0;jenkins-hbase9:33029] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 14:11:29,401 INFO [M:0;jenkins-hbase9:33029] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 14:11:29,401 INFO [M:0;jenkins-hbase9:33029] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 14:11:29,402 DEBUG [M:0;jenkins-hbase9:33029] master.HMaster(1512): Stopping service threads 2023-07-11 14:11:29,402 INFO [M:0;jenkins-hbase9:33029] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 14:11:29,402 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 14:11:29,402 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:11:29,402 ERROR [M:0;jenkins-hbase9:33029] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-07-11 14:11:29,403 INFO [M:0;jenkins-hbase9:33029] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:11:29,403 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 14:11:29,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:11:29,405 DEBUG [M:0;jenkins-hbase9:33029] zookeeper.ZKUtil(398): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 14:11:29,405 WARN [M:0;jenkins-hbase9:33029] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 14:11:29,405 INFO [M:0;jenkins-hbase9:33029] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:11:29,405 INFO [M:0;jenkins-hbase9:33029] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 14:11:29,405 DEBUG [M:0;jenkins-hbase9:33029] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 14:11:29,405 INFO [M:0;jenkins-hbase9:33029] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:11:29,405 DEBUG [M:0;jenkins-hbase9:33029] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:11:29,405 DEBUG [M:0;jenkins-hbase9:33029] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 14:11:29,406 DEBUG [M:0;jenkins-hbase9:33029] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:11:29,406 INFO [M:0;jenkins-hbase9:33029] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.97 KB heapSize=599.09 KB 2023-07-11 14:11:29,415 INFO [M:0;jenkins-hbase9:33029] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.97 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1e986b7caa7e455aa48b80ecf14d4d9a 2023-07-11 14:11:29,419 INFO [M:0;jenkins-hbase9:33029] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e986b7caa7e455aa48b80ecf14d4d9a 2023-07-11 14:11:29,420 DEBUG [M:0;jenkins-hbase9:33029] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1e986b7caa7e455aa48b80ecf14d4d9a as hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1e986b7caa7e455aa48b80ecf14d4d9a 2023-07-11 14:11:29,425 INFO [M:0;jenkins-hbase9:33029] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e986b7caa7e455aa48b80ecf14d4d9a 2023-07-11 14:11:29,425 INFO [M:0;jenkins-hbase9:33029] regionserver.HStore(1080): Added hdfs://localhost:43437/user/jenkins/test-data/abca1dbd-c729-f358-5ae5-7ebd8ea5a0e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1e986b7caa7e455aa48b80ecf14d4d9a, entries=123, sequenceid=1011, filesize=33.3 K 2023-07-11 14:11:29,426 INFO [M:0;jenkins-hbase9:33029] regionserver.HRegion(2948): Finished flush of dataSize ~512.97 KB/525283, heapSize ~599.08 KB/613456, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=1011, compaction requested=false 2023-07-11 14:11:29,430 INFO [M:0;jenkins-hbase9:33029] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:11:29,430 DEBUG [M:0;jenkins-hbase9:33029] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 14:11:29,435 INFO [M:0;jenkins-hbase9:33029] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 14:11:29,435 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 14:11:29,436 INFO [M:0;jenkins-hbase9:33029] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33029 2023-07-11 14:11:29,438 DEBUG [M:0;jenkins-hbase9:33029] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,33029,1689084552049 already deleted, retry=false 2023-07-11 14:11:29,498 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:11:29,498 INFO [RS:0;jenkins-hbase9:46743] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,46743,1689084553537; zookeeper connection closed. 2023-07-11 14:11:29,498 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): regionserver:46743-0x10154a9a35c0001, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:11:29,498 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@676244f8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@676244f8 2023-07-11 14:11:29,499 INFO [Listener at localhost/44533] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-11 14:11:29,598 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:11:29,598 DEBUG [Listener at localhost/44533-EventThread] zookeeper.ZKWatcher(600): master:33029-0x10154a9a35c0000, quorum=127.0.0.1:63702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:11:29,598 INFO [M:0;jenkins-hbase9:33029] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33029,1689084552049; zookeeper connection closed. 2023-07-11 14:11:29,600 WARN [Listener at localhost/44533] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 14:11:29,613 INFO [Listener at localhost/44533] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 14:11:29,720 WARN [BP-340899230-172.31.2.10-1689084547010 heartbeating to localhost/127.0.0.1:43437] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 14:11:29,720 WARN [BP-340899230-172.31.2.10-1689084547010 heartbeating to localhost/127.0.0.1:43437] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-340899230-172.31.2.10-1689084547010 (Datanode Uuid 7711d16e-95a7-4523-af51-8072bab1d975) service to localhost/127.0.0.1:43437 2023-07-11 14:11:29,723 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c/dfs/data/data1/current/BP-340899230-172.31.2.10-1689084547010] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:11:29,723 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/8acef4cb-0320-f4ee-c38e-02e3e5855bdc/cluster_9da97cc1-2aee-7a7a-8d25-65cd05fe1c8c/dfs/data/data2/current/BP-340899230-172.31.2.10-1689084547010] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:11:29,789 INFO [Listener at localhost/44533] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 14:11:29,931 INFO [Listener at localhost/44533] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 14:11:30,066 INFO [Listener at localhost/44533] hbase.HBaseTestingUtility(1293): Minicluster is down